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SYSTEM AND METHOD FOR HYBRID MINIMUM MEAN SQUARED ERROR 
MATRIX-PENCIL SEPARATION WEIGHTS FOR BLIND SOURCE SEPARATION 

Cross-Reference To Related Application 

5 [0001 ] The present application is related to and co-pending with commonly-assigned U.S. 
Patent Application S.N. 10/360,631 entitled "Blind Source Separation Utilizing A Spatial Fourth 
Order Cumulant Matrix Pencil", filed on 10 February 2003, the disclosure of which is hereby 
incorporated herein by reference. 

[0002] The present application is related to and co-pending with commonly-assigned U.S. 
10 Patent Application S.N. 10/400,486 entitled "Method And System For Waveform Independent 
Covert Communications", filed on 28 March 2003, the disclosure of which is hereby 
incorporated herein by reference. 

[0003] The present application is co-pending with and claims benefit of U.S. Provisional 
Patent Application Serial No. 60/458,038 entitled "Cooperative SIGINT for Covert 
15 Communication and Location Provisional", filed on 28 March 2003, the entirety of which is 

hereby incorporated herein by reference. ^ 

Government License Riglits 

[0004] The U.S. government has a paid-up license in this invention and the right in limited 
20 circumstances to require the patent owner to license others on reasonable terms as provided for 
by the terms of Contract No. NRO000-02-C-0389 awarded by the National Reconnaissance 
Office. 

Background 

25 [0005] The present invention is generally related to separating individual source signals 
from a mixture of source signals, and more specifically related to blind source separation. 

[0006] A classic problem in signal processing, often referred to as blind source 
separation ("BSS"), involves recovering individual source signals from a composite signal 
comprising a mixture of those individual signals. An example is the familiar "cocktail party" 
30 effect, wherein a person at a party is able to separate a single voice from the combination of all 
voices in the room. The separation is referred to as "blind" because it is often performed with 
limited information about the signals and the sources of the signals. 
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[0007] Blind source separation is particularly applicable to cellular and personal wireless 
communications technologies, wherein many frequency bands have become cluttered with 
numerous electromagnetic emitters, often co-existing in the same spectrum. The problem of co- 
channel emitters is expected to only worsen in years to come with the development of low 
5 power, unlicensed wireless technologies such as Bluetooth® and other personal area networks. 
These developments have resulted in the use of multiple sensors and array signal processing 
techniques to perform spectral monitoring. Such techniques enable the exploitation of spatial 
information to separate co-channel emitters for detection, classification, and identification. 
Additionally, many signals designed for a low probability of detection (LPD) or low probability 
10 of intercept (LPI) may use ambient background electromagnetic radiation and known co-channel 
emitters as a means of concealment. Constructing single sensor receiver systems with the 
required sensitivity to such emitters is generally prohibitive. Thus, many applications utilize 
BSS and sensor arrays. 

[0008] As described in "Blind Source Separation Utilizing A Spatial Fourth Order 
15 Cumulant Matrix Pencil" referenced above, a first order matrix pencil BSS method using a 
smoothed spatial fourth-order cumulant matrix definition was developed to avoid impractical 
restrictions on the sensor array characteristics and/or noise environment. The approach therein 
described exploits the fact that the fourth-order cumulants are insensitive to either spatial or 
temporal correlation in Gaussian sensor noise since the higher-order cumulants of Gaussian 
20 random processes are zero. The method advantageously does not sacrifice any degrees of 
freedom to estimate a Gaussian noise subspace, making it capable of using all the degrees of 
freedom for separating as many sources as there are sensors in the array. In order to estimate the 
adaptive complex sensor weights for separating the multiple sources, a spatial fourth-order 
cummulant matrix pair is formed for two different sets of time lags between the observations 
25 from the different sensors. 

[0009] A general eigenvalue decomposition of the smoothed Spatial Fourth Order 
Cumulant Matrix ("SFOCM") pencil is used to find the adaptive separation weight vectors. 
Since the generalized eigenvectors are orthogonal to all but one of the steering vectors, the 
adaptive weights are formed from normalized eigenvectors. These weights maintain gain on a 
30 particular source while minimizing the output power due to the other intervening sources. 

However, the normalized eigenvector weights do not reduce the output power due to additive 
Gaussian noise at the sensors. Accordingly, an improved blind source separation technique is 
desired. 
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[001 0] Thus embodiments of the disclosed subject matter are extensions and counter 
parts to the SFOCMP approach, which minimize the output power of the interferers and the 
output power of the Gaussian sensor noise. 

[001 1] hi one embodiment of the present invention, a method for separating a plurality of 
5 signals provided by a respective plurality of sources and received by an array comprising a 
plurality of elements, includes generating a separation matrix as a function of time differences 
between receipt of the plurality of signals by the plurality of elements, a spatial fourth order 
ciunulant matrix pencil or a pair of 2"^ order correlation matrices, a spatial correlation matrix and 
steering vectors of said plurality of signals. The method also includes multiplying the separation 
10 matrix by a matrix representation of the plurality of signals. 

[001 2] In another embodiment of the present invention, a system for separating a 
plurality of signals provided by a respective plurality of sources includes a receiver for receiving 
the plurahty of signals and for providing received signals. The system also includes a signal 
processor for receiving the received signals, generating a separation matrix, and multiplying the 
15 separation matrix by a matrix representation of the received signals. The separation matrix is a 
function of time differences between receipt of the plurality of signals by the receiver, a function 
of a spatial fourth order cumulant matrix pencil or a pair of 2"** order correlation matrices, a 
spatial correlation matrix and steering vectors of said plurality of signals. 

20 Brief Description Of The Drawings 

[001 3] In the drawings: 

[0014] Figure 1 is a functional block diagram of a system for performing blind source 
separation utilizing a spatial fourth order ciunulant matrix pencil in accordance with an 
embodiment of the present invention; 

25 [001 5] Figure 2 is an illustration of signal source, array elements, and a processor for 
performing array signal processing and BSS processing in accordance with an embodiment of 
the present invention; 

[001 6] Figure 3 is an illustration of a MIMO blind channel estimation scenario showing 
five unknown sources having distinct radiating pattems and five sensors having distinct receiving 
30 pattems. 

[001 7] Figure 4 is a graphical illustration of time delays between sensors and sources. 
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[001 8] Figure 5 is an illustration depicting blind source separation (BSS) showing an 
input signal mixed with noise provided to the separation process. 

[001 9] Figure 6 is an illustration depicting repeating the separation process for a single 
repeated eigenvalue. 

5 [0020] Figure 7 is a flow diagram of a process for performing blind source separation 
using the spatial fourth-order cumulant matrix-pencil in accordance with an embodiment of the 
present invention. 

[0021 ] Figure 8 is a continuation of the flow diagram of Figure 7. 

[0022] Figure 9 is an embodiment of a Blind Source Separation system with normalized 
1 0 eigenvectors (adaptive weights). 

[0023] Figure 10 is an embodiment of a Blind Source Separation system with Optimum 
MMSE Separation vectors (hybrid weights). 

[0024] Figure 1 1 a is an output ISR vs received SNR performance graph comparing 
adaptive weights and with hybrid weights with isotropic white noise. 

15 [0025] Figure 1 lb is an output ISR vs received SNR performance graph comparing 
adaptive weights and with hybrid weights with isotropic white noise. 

[0026] Figure 12a is an output ISR vs received SNR performance graph comparing 
adaptive weights and with hybrid weights with non-isotropic spatially and temporally correlated 
Gaussian noise. 

20 [0027] Figure 12b is an output ISR vs received SNR performance graph comparing 

adaptive weights and with hybrid weights with non-isotropic spatially and temporally correlated 
Gaussian noise. 

Detailed Description 

25 [0028] A technique for performing blind source separation (BSS) in accordance with the 
present invention utilizes cumulants in conjunction with spectral estimation of the signal 
subspace to perform the blind separation of statistically independent signals with low signal-to- 
noise ratios under a narrowband assumption. This BSS technique makes use of the generaUzed 
eigen analysis of a matrix-pencil defined on two similar spatial fourth-order cumulant matrices. 

30 The herein described BSS technique utilizes a higher-order statistical method, specifically 

fourth-order cumulants, with the generalized eigen analysis of a matrix-pencil to blindly separate 
a linear mixture of unknown, statistically independent, stationary narrowband signals at a low 
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signal-to-noise ratio having the capabiUty to separate signals in spatially and/or temporally 
correlated Gaussian noise. This BSS technique provides a method to blindly separate signals in 
situations where no second-order technique has been found to perform the blind separation, for 
example, at a low signal-to-noise ratio when the nxmiber of sources equals the number of sensors. 

5 [0029] To describe this BSS technique, a definition of a spatial fourth-order cumulant 
matrix suited to blind source separation with non-equal gain and/or directional sensors and a 
definition of a spatial fourth-order cumulant matrix-pencil using temporal information are 
provided. The herein description also utilizes the concept of separation power efficiency (SPE) 
as a measure of the BSS technique's performance, and applies the concept of wide sense 
10 equivalence between matrix-pencils to the field of matrix algebra. 

[0030] As an overview, the BSS technique described herein utilizes cumulants in 
conjunction with a spectral estimation technique of the signal subspace to perform blind source 
separation in the presence of spatially and/or temporally correlated noise at low signal-to-noise 
ratios. Prior to deriving a separation algorithm based on cumulants, a narrowband array model is 

15 developed, all assumptions are stated, four performance measures are defined, and the relevant 
cumulant properties that allow for the spatial mixing matrix information to be extracted fi-om a 
spatial cumulant matrix are presented. A novel spatial cumulant matrix definition is then 
developed and its' relevant matrix properties are derived in order to determine which 
mathematical methods are valid for extracting the spatial information about the mixing matrix. 

20 Additionally, two altemative definitions for the spatial fourth-order cumulant matrix are 

described and relevant properties are derived. Furthermore, the definitions, properties, and use 
of a generaUzed eigen analysis of a matrix-pencil defined on two similar spatial fourth-order 
cumulant matrices are explored and their applicability to solving the blind source separation 
problem is investigated. A process is described for performing the blind source separation based 

25 on the signal subspace technique using matrix-pencils. In the process the concept of wide sense 
equivalence between matrix-pencils is developed and then used to show that the generalized 
eigenvalues of a matrix-pencil defined on two similar spatial fourth-order cumulant matrices are 
equal to the ratio of fourth-order cumulant of each source at a set of time lags (0,0,0) to the 

fourth-order cumulant at the set of lags, (^,,72,73). Thus the concept of a normalized fourth- 

30 order auto-cumulant fimction is introduced. To fiirther aid in understanding this BSS technique, 
notation used herein is presented below. 

M = Number of Sources 
A''^ Number of Sensors 
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Pj = Normalized Power of the source signal 

ntj [t) = Continous Time Unit Power Modulated Signal from the source 

Sj (t) = Continous Time Signal from the source = (t) 

Vj (/) = Delayed version of Sj {t) 

X( [t)= Continous Time Signal from the sensor. 

x(^)= The vector of sensor outputs. 

hy (/) = Continous Time Impulse Response of the channel between the source 
and the sensor 

n. (f) = Additive Noise Process at the i^* sensor. 

af = Variance of the Noise Process at the sensor. 

r» = Propogation Delay from the source to the sensor 

Ar^^ y = "Differential Time Delay'', The difference in propogation delay from the output 
J of the source to the sensor output and from the output of the source 

to the /* sensor output. 

Tj = "Reference Time Delay" from the y^'^source to some arbitrary array reference point 
in the vicinity of the array. Nominally this can be the average propogation delay to 
all N sensors from the 7'* source. 

At.j = "Relative Time Delay", The difference in propogation time from the source 
to the /'^ sensor and the array refence point. 

T = Time Difference in Correlation of Stationary Processes 

Vy = Complex Weight for the source at the sensor for the Narrow Band Model. 
The ij element of the "Mixing Matrix". The / element of the J steering vector. 

10 \j= The f "Steering Vector" for the Narrow Band Model. 
V = The Narrow Band Model "Mixing Matrix". 

Wy = Complex Weight for the source at the z* sensor for the Narrow Band Case. 

The ij element of the "Separating Matrix". The i^ element of the sensor 
weight vector. 

'^j.hyb - The hybrid MMSE weight vector estimate for the j^^ source. 
W = The "Separation Matrix". 

a-j= Real valued gain(attenuation) of the channel from the source output to the 
sensor output. 
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BWj^^^l ]^ Noise Equivalent Bandwidth 

BWy^" = Coherence bandwidth of the Channel between the y^'^source and the sensor. 

yj (t) s The output from the separation process. It is a noisy estimate of the 
of the 7^*delayed source signal, rj (t). 

y{t) = The vector of output signals from the separation process. 

5 Pj = The signal loss term. Element of the ''loss'' matrix. 

Sj = The separation process output signal power of the J*^ source signal. 

I J = The residual interference power in the separation process output. 

Nj = The noise power in the 7'* separation process output. 

The "Interference -to -Signal Ratio'' for the/* separation process output. 

10 ISR^ = The "Average Interference - to - Signal Ratio". 

ISR^ = The "Maximum Interference -to -Signal Ratio", 

= The "Power Efficiency" of a blind source separation algorithm for the source. 

= The "Average Power Efficiency" of a blind source separation algorithm. 

^mn = The "Minimum Power Efficiency" of a blind source separation algorithm. 

^ ^ (r, , , ) s NxN " Spatial Fourth - Order Cumulant Matrix 1 " with delay 

lags T^,T2,Ty 

^i{^v^2^h)= "Spatial Fourth -Order Cumulant Matrix 2" with delay 

lags T^^T^^T^. 

cf {r^,T2,T^)= NxN "Spatial Fourth -Order Cumulant Matrix 3" with delay 

lags T^yT^.T^, 

Cum[ ]s Cumulant Operator. 

(rj , ^2 , ) = The fourth-order cumulant of the source signal with delay 

lags TjjTjjTj. Also referred to as the fourth-order auto-cumulant. 

20 V = The "Modified Mixing Matrix''. Defined as the Hadamard Product V © V © V. 

^/(^p^2»^3)~ The normalized foiuth-order cumulant of thej^* source signal with 
delay lags rpr2,r3. Also referred to as the normalized fourth-order 
auto-cumulant. 
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(71,7-2,73)= MxM Diagonal Fourth - Order Signal Cumulant Matrix'' with delay 

lags T^,T^,T^, 

C ( )= ''Column Space" of a matrix. 

N ^( ) s The "Rigth Null Space" of a matrix. 

N i{ ) = The "Left Null Space" of a matrix. 

Ij^=NxN Identity Matrix. 

tr{)= The "Trace" of a matrix. 

sp{)= The "Span" of a sub-space. 

/?( )= The "Rank" of a matrix. 

f = Vector notation for the set of delay lags, {7, , , } . 

P, (A, t) s The "Spatial Fourth - Order Cumulant Matrix - Pencil" using a pair of 
Spatial Fourth-Order Cumulant Matrix Ts. 

(A,t) = The "Spatial Fourth - Order Cumulant Matrix - Pencil" using a pair of 
Spatial Fourth-Order Cxmiulant Matrix 2*s. 

Pr(^, f ) = The "Spatial Fourth - Order Cumulant Matrix - Pencil" using a pair of 
Spatial Fourth-Order Cumulant Matrix 3*s. 

Pf (>^, t) = The "Fourth - Order Signal Cumulant Matrix - Pencil" using a pair of 
Diagonal Fourth-Order Signal Cumulant Matrices. 

R^ = The estimated zero-lag spatial correlation matrix. 

Kj = The interference-plus-noise correlation matrix estimate for the j source. 

/1(A,B) = The "Spectrum" of the pencil defined on the matrices A and B. 
The set of generalized eigenvalues. 

yl(A,B) = The "Finite Spectrum" of the pencil defined on the matrices A and B. 
The set of non-zero finite generalized eigenvalues. 

Xj = The "f^ Eigenvalue" of the pencil defined on a pair of spatial fouth-order cumulant 
matrices. There are M such eigenvalues, counting multiplicities. takes on one 
of the K values of //^^ . 
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jUf^ = The "fc^* Distinct Eigenvalue'' of the pencil defined on a pair of spatial fouth-order 
cumulant matrices. There are K such values that the set of XjS takes on. 

gf^ = The set of indeices, { j] , where Xj = ju^^. 

= The Nxl 7'* Eigenvector" of the pencil defined on a pair of spatial fouth-order 
cumulant matrices associated with the eigenvalue Aj. 

5 /j= The ''Normalization Factor" for the 7'* eigenvector. / = 

^geom ^ jj^g ''Geometric" Multiplicity of an Eigenvalue. 
= The "Algebraic" Multiplicity of an Eigenvalue. 
- The "Multiplicity" of an Eigenvalue when rir"'^r]k^. 
* = Either conjugation or convolution, as appropriate fi'om the context of the use. 

10 

[0032] Figure 1 is a fimctional block diagram of a system 100 for performing blind 
source separation utilizing a spatial fourth order cumulant matrix pencil in accordance with an 
embodiment of the present invention. System 100 comprises a receiver 1 1 and a signal processor 
12. The receiver 1 1 receives signal s(t), which is indicative of a plurality of signals provided by 

15 a respective plurality of sources and provides signal x(t) to the signal processor 1 2. The receiver 
1 1 may be any appropriate receive configured to receive the signal s(t). For example, the signal 
s(t) may be an acoustic signal, an optical signal, a seismic signal, an electromagnetic signal, or a 
combination thereof, and the receiver 1 1 may be configured to receive the respective type of 
signal. In one embodiment, the receiver 1 1 is configured as an array having a plurality of 

20 elements. The signal s(t) is received and appropriately processed (e.g., time delayed and 
multiplexed) and provided to the signal processor 14 in the form of signal x(t). 

[0033] The signal processor 12 may be any appropriate processor configured to process 
the signal x(t), such a general purpose computer, a laptop computer, a special purpose computer, 
a hardware implemented processor, or a combination thereof The signal x(t) may be in any 
25 appropriate format, such as an optical signal, and electromagnetic signal, a digital signal, and 
analog signal, or a combination thereof As will be explained in more detail below, the signal 
processor 12 comprises a matrix pencil estimation portion 13, a non-zero finite eigenvalue 
determination portion 14, a number of distinct eigenvalues determination portion 15, a 
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multiplicity determination portion 16, a linearly independent eigenvector calculation portion 17, 
a normalization factor calculation 18, a separation vector generation portion 19, a separation 
matrix generation portion 20, and an optional separation power efficiency calculation portion 21. 
The matrix pencil estimation portion 13 is configured to estimate the spatial fourth order 
5 cumulant matrix pencil as a function of time differences of the arrival of the signal s(t) at the 
elements of the receiver 11. The non-zero finite eigenvalue determination portion 14 is 
configured to determine the non-zero finite eigenvalues for the spatial fourth order cumulant 
matrix pencil. The number of distinct eigenvalues determination portion 15 is configured to 
determine the number of eigenvalues that are distinct. The multiplicity determination portion 16 

10 is configured to determine the multiplicity of each of the distinct finite eigenvalues. The linearly 
independent eigenvector calculation portion 17 is configured to calculate linearly independent 
eigenvectors for each of the distinct finite eigenvalues. The normalization factor portion 18 is 
configured to calculate, for each eigenvalue having a multiplicity equal to one, a normalization 
factor and to generate a respective separation vector as a function of the normalization factor and 

15 an eigenvector corresponding to the eigenvalue having a multiplicity equal to one. The 

separation vector generation portion 19 is configured to generate, for each repeated eigenvalue, a 
separation vector as a function of an eigenvector corresponding to the repeated eigenvalue. The 
separation matrix generation portion 20 is configured to generate the separation matrix as a 
function of the separation vectors. The optional separation power efficiency calculation portion 

20 21 is configured to calculate the efficiency of the separation process in accordance with the 
following formula: Cj=Sj/Pj, wherein Q is indicative of the separation power efficiency for the 
source of the plurality of sources, Sj is indicative of a power of a separated signal from the j^^ 
source, and Pj is indicative of a normaUzed power of a signal from the j*^ source. 

[0034] Figure 2 is an illustration of signal source 24, array elements 26, and a processor 
25 22 for perfomiing array signal processing and BSS processing in accordance with an 

embodiment of the present invention. Array signal processing is a specialization within signal 
processing concerned with the processing of a set of signals generated by an array of sensors at 
distinct spatial locations sampling propagating wavefields, such as electromagnetic, seismic, 
acoustic, optical, mechanical, thermal, or a combination thereof, for example. As shown in 
30 Figure 2, the array samples the wavefield, Vj {t,z.) , generated by the source 24j at 

locations {fi,Z2,...,z^} (only one location, zj, shown in Figure 2) with a set of sensors 26i which 

generate signals Xi(t) indicative of the wavefield at each location, Zj. The signals Xi(t) may be any 
appropriate type of signal capable of being processed by the processor 22. Examples of 
appropriated types of signals Xi(t) include electrical signals, acoustic signals, optical signals, 
35 mechanical signals, thermal signals, or a combination thereof The signal [t) provided by the 
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sensor, 26i, comprises the sum of the wavefields from all sources 24 at each sensor's location, 
each weighted with response of the sensor in the signal's Vj [t, z. ) direction of arrival, plus an 

additive noise term, n- (/) . As described in more detail herein, the processor 22 processes the 

signals x(t) for enhancing sets of sources signals' individual signal-to-interference-plus-noise 
5 ratios by suppressing interfering source signals at different spatial locations without knowledge 
of the source signal characteristics, the channels between the sources and the array elements, the 
sources' locations, or array geometry via a blind source separation (BSS) technique in 
accordance with the present invention. 

[0035] A blind source separation technique in accordance with the present invention is 
10 described herein by defining underlying assumptions made about the source signals and noise 
sources. Different multiple input multiple output (MIMO) array channel models are described 
resulting in a narrowband model, which is utihzed in the BSS technique in accordance with 
present invention. 

[0036] Blind source separation (BSS) is applicable to many areas of array signal 
1 5 processing that require the enhancement and characterization of an imknown set of source 

signals generated by a set of sensors that are each a linear mixture of the original signals. These 
include, for example, signal inteUigence, spectral monitoring, jamming suppression, and 
interference rejection, location, and recognition. Typically, the mixing transformation, source 
signal characteristics, and sensor array manifold are unknown. Thus, blind source separation 
20 may be viewed as a multiple-input, multiple-output (MIMO) blind channel estimation problem. 

[0037] Figure 3 is an illustration of a MIMO blind channel estimation scenario showing 
five unknown sources, Si, S2, S3, S4, S5, having distinct radiating patterns and five sensors, xi, X2, 
X3, X4, X5, having distinct receiving patterns. The sources, si, S2, S3, S4, S5, may provide and the 
sensors, xi, X2, X3, X4, X5, may correspondingly receive, acoustic energy, electromagnetic energy, 

25 optic energy, mechanical energy, thermal energy, or a combination thereof As shown in Figure 
3, the five unknown sources, si, S2, S3, S4, S5, with distinct radiating patterns are generating a set 
of wavefields that are impinging on an array of five sensors, xi, X2, X3, X4, X5, with an unknown 
array manifold. Each source, si, S2, S3, S4, S5, provides a respective source signal. A BSS 
separation technique in accordance with the present invention, jointly extracts the set of source 

30 signals from an array of sensors (e.g., xi, X2, X3, X4, X5,) sampling the aggregate (composite) of 
the source signals' propagating wavefields at distinct spatial locations without knowledge of the 
signal characteristics or knowledge of the array's sensitivity as a fiinction of direction of arrival 
or geometry. 
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[0038] In order to develop a blind source separation technique suitable for separating 
narrowband signals given a set of outputs from an array of sensors with a relatively small spatial 
expanse and assess its performance, it is advantageous to develop a multiple-input multiple- 
output (MMO) narrowband channel model for the array, state assumptions made, state the 
5 problem mathematically, and develop a set of measures to evaluate the technique. 

[0039] As such, a narrowband MIMO channel model is developed by starting with the 
most general convolutional MMO channel model and then placing restrictions on the signal 
bandwidth and array size to simplify the problem, resulting in the narrowband model as utilized 
herein. Signal and noise assumptions are then presented and the blind source separation 
10 technique in accordance with the present invention is described mathematically and graphically. 
Two performance measures to be used in assessing the performance are then described including 
the novel concept of separation power efficiency (SPE). 

[0040] Four multiple-input multiple-output (MIMO) channel models applicable to the 
blind source separation problem are described herein. These models are the general chaimel 
15 model, the non-dispersive direct path only channel model, the general finite impulse response 
(GFIR) channel model, and the narrowband channel model. The BSS technique in accordance 
with the present invention is then described utilizing the narrowband channel model. 

[0041 ] The General Channel Model : In the most general case, the output of each element 
is modeled as a summation of the M source signals each convolved with the impulse response 
20 of the chaimel between the output of the source and output of the sensor plus the additive 
Gaussian noise referenced to the sensors input. That is, 

M 

^.(0 = Z^i^(0*^yW+«/(0 (1) 

7=1 

where * denotes convolution. The impulse response, Vy , of the channel between the output 
of the /* source and the sensor output may be time varying and account for such phenomena 
25 as multi-path propagation, dispersion, sensor time-varying response, source motion, sensor 
motion, etc. This can be written in matrix form as the general multiple input multiple output 
(MIMO) channel model 











+ 
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where [ ] denotes transposition. 

[0042] The Non-Dispersive. Direct Path Only Channel Model : When there is no multi- 
path, motion, or dispersion, the channel impulse response can be modeled by a delay and 
attenuation. That is, 

v,{t)^ayS{t-T,) (3) 

where Uy is the cascaded attenuation/gain from the output of source to the i^^ sensor output 
and Ty is the propagation time (delay) from the output of source to the output of the z'* 

sensor. Under this model, when the sifting property of the delta function is employed, the output 
of the sensor (ignoring the noise) becomes 



M 

10 =Z«.^(^-^.)*^;W (4) 

M 

= ll^ij'j(^-^ij) 

[0043] At this point a "differential" delay is defined as the difference in propagation time 
from the output of the source to the output of the k*^ sensor and to the output of the 

sensor. 

15 This differential time delay defines the time difference of arrival between two sensors for a given 
signal and is a measure of the spatial expanse of the array of sensors. Additionally, to facilitate 
situations when the minimiml propagation delay from the 7'* source to the sensors is much 
greater than the maximum differential propagation delay, that is min (r^. ) I » niax \AT^ f^ j | , the 

propagation time Ty is decomposed into two components, a "reference" delay, which is defined 

20 as the average propagation time from the output of the source to the output of the sensors and 
denoted as r} , and a "relative" delay, which is defined as the difference in propagation time 

between the reference time delay and the actual propagation time and denoted as Aty. The 

propagation time from the source to the i'* sensor can then be expressed as 

ry=Tj^ATy. (6) 

25 [0044] Figure 4 is a graphical illustration of time delays between sensors and sources. 
The decomposition of the propagation time as depicted in Figure 4 includes five sources, labeled 
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5, , ^2 , . . . , ^5 , with associated reference delays f| , , . . . , , which are generating a set of 
wavefields that illuminate a set of five sensors, labeled jc, , , . . . , , and the relative time delay, 
idrj, , is shown for the first source, , and the third sensor, . Using the above definitions, the 
differential time delay can be reformulated as follows: 

5 =(r,+^r,)-(f,+^r^.) (7) 

Both the differential and relative time delays are utilized in the formulation of the narrowband 
and the general finite impulse response models. 

[0045] The General Finite Impulse Response (GFIR) Channel Model : The general 
model is often simplified by modeling the channel between the output of the source and the 
10 sensor output, Vy (t) , as a FIR filter or tapped delay line. As with the general model, the 

GFIR Model may be time varying and can account for such phenomena as multi-path 
propagation, dispersion, sensor time-varying response, system motion, etc. The FIR fiUer used 
to model Vy [t) must be long enough to account for the multi-path delay spread of the channel as 

well as the relative time delay, Aty , with a "reference" delay, fj , accounted for by defining a 

15 delayed version of the source signal as it's input. That is the input to the set of FIR filters used to 
model the channels between the output of the source and array of sensors is 

0W = ^;(^-^;)- (8) 



[0046] The FIR filter or tapped delay line model is valid for a fading channel when the 
20 coherence bandwidth of such a channel is much less than the noise equivalent bandwidth of the 
source signal, that isBW^^^ [5^ (r)] < BW^^" , where the coherence bandwidth is defined as the 

reciprocal of the multi-path delay spread. In this situation the multi-path components in the 
channel separated by a delay of at least iTtj BW^^^ ^Sj (r)] are resolvable and the fading 

phenomenon is referred to as being "frequency selective". Thus the channel impulse response 
25 can be represented as 

V, (0 = I V? {t)S(t - InljBW,^ (0]) (9) 

where the time varying complex-valued channel gain of the component can be represented as 

^f{t) = <^(t)e>^^. (10) 

14 
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The length of the model, Ly , is the number of resolvable multi-path components which is 

L,=\BW,^[sj(t)\lBW^'>"] (11) 

where [ ] denotes the ceiling function. For the GFIR channel model, the length of the FIR filter 
has to not only accommodate the multi-path delay spread but also the relative time delay, Ar^j . 

5 That is equation (11) becomes 

=[*'^«.h(')]{(^%IA^)+(i/f»r')]l- (12) 

In practice, the length of all the FIR filters are set to a common value, L , which is defined as 

Z = max(L^). (13) 

[0047] When the coherence bandwidth is greater than the noise equivalent bandwidth of 
10 the source signal, that is BW^^^ (/)] < BWy^" , the fading is referred to as "fi-equency non- 
selective" and the fading model reduces to a single time varying complex weight. That is Ly=l, 
and thus 

= af^(t)e^^'^'^ (14) 

which begins to look like a time-varying narrowband model. However, for the above 
15 simplification to a single complex weight to hold in array signal processing, the source signal 
must have a noise equivalent bandwidth much less then the center firequency and the array of 
sensors must have a relatively small spatial expanse, that is 

5FFNEq[Sj(t)]«C0j (15) 

mp|zir^.| « tt/bW^,^ [sj (/)] . (16) 

20 [0048] The Narrowband Chaimel Model : A measure of the spectral support of a signal is 
the noise equivalent bandwidth, denoted as BWj^^ [ ] . By the duality principle of time and 

firequency, the inverse noise equivalent bandwidth can be used as a measure of the temporal 
support of the signal, in other words it is can be used as an indication of the decorrelation time of 
the signal. When the signal noise equivalent bandwidth is much less then the center frequency, 
25 that is 

5fFNEq[Sj(t)]«C0j (17) 
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10 



where (Oj is the center frequency of the y** source, then the propagation delay, or relative 

propagation delay, can be modeled as a phase shift. In this situation, when there is no dispersion 
or multi-path, the channel model is referred to as the narrowband model. 

[0049] However, since the phase shift is modulo In with respect to the center fi^equency, 
the requirement that the bandwidth be much less than the center frequency is itself insufficient in 
order for the time delay to be modeled as a phase shift and preserve the waveform, i.e. negligible 
inter-symbol interference (ISI) is induced in a digital communications signal. Therefore, for the 
narrowband model to hold, the array of sensors must also have a relatively small spatial expanse. 
That is 

max|^r,,J« Itt/ BW^,^[sj{t)\ (18) 

Since At^j^ j = Ar^j - ^r^- , requiring 

mp|zlr^| « 7rlBW,,^[sj{t)\ (19) 

is a sufficient condition to guarantee (18) holds, via the triangle inequality. When the 
Narrowband conditions defined in (17) and (19) hold, the relative time delay is neghgible in 
15 comparison to the decorrelation time of the signal and thus 

Sj[t-fj-AT,) = Sj[t-Zj) (20) 

which says the waveform is preserved (within a phase shift). Thus, the relative time delay can be 
modeled as a phase shift, 

= aySj[t-ry) 

= a„s,(t-rj-At^ (21) 

20 where rj [t) = Sj {t - 7, ) , = OjAtg , and a complex weight, v^. , is defined as 

v,=cc,^'*'. (22) 

This complex weight together with the other N-l weights associated with the signal form 
the steering vector. 

V7=K- ^2y ^NiJ (23) 



WSH\98573.1 



16 



GCSD-1430 



HAR62 020 



[0050] 



The output of the /** sensor is then 



M 



7=1 



(24) 



As done for the general m y '* model, this can be re-formulated in matrix form for the vector of 
sensor outputs as 

x{t) = [x,{t) x,{t) ... X^{t)J 



















+ 








(0. 













"".(')" 


= [v, ... y^] 

















(25) 



= Vr(/)+n(/) 

[0051] Due to conservation of energy, the total average signal power from the source 
illuminating the array can never exceed Pj . Since the signal-to-noise ratio is established at the 

input of the sensor, in the total array gain can be viewed as being normalized. Thus for the 
narrowband model, the inner product of the column of the mixing matrix V is, 

N 

H ♦ 

v . V . = > V- V.. 



N 



N 



(26) 



(=1 



= 1 

where [ ]" denotes the Hermitian transpose. 

[0052] Signal and Noise Assumptions: The following assumptions are made about the 
source signals and noise vector. These assumptions are made to allow the use of the fourth-order 
cumulant and to ensure a sufficient number of degrees of freedom for the separation technique to 
exploit. Assumptions Al and A2 ensure that the fourth-order cumulant of the source signals 
exist. The zero-mean assimiption is not necessary for the use of cumulants but is assimied since 
practical propagating electro-magnetic signals have a zero-mean. Assxmiptions A3 and A4 are 
particularly useful to the use of cumulants for the BSS problem. Without them, the noise sources 
would need to be treated as a signal source thus requiring additional degrees of freedom in the 
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array. Note that the noise sources are not assumed to be temporally or spatially white. This is 
contrast to assumptions made in other second order techniques. The final assumption on the 
number of source signals helps to ensure that the there are enough degrees of freedom to perform 
the separation using the matrix-pencil approach. 

5 [0053] The first assumption (Al) : The M source signals illuminating the array are 
statistically independent non-Gaussian stationary random processes. Assumption Al is 
represented mathematically as follows. 

4. .«(^.'^2-.'i.)=n/o(o) (27) 

The source signals are assiuned stationary to order four over the estimation period of the spatial 
1 0 fourth-order cumulant matrix. 

[0054] The second assumption (A2\ . The M source signals illuminating the array have 
zero mean with power P. and a non-zero fourth-order moment. Assumption A2 is represented 



mathematically as follows. 

E[mj{t)\ = Q (28) 

15 E[rj (/)] = E[^jmj (t)] = ^jE[mj (t)] = 0 (29) 

E[m.[t)m]{t)\ = \ (30) 

E[rj {t)r] (/)] = EyPjmj (t)^jm] (t)] = /^.^[m, {t)m] (t)] = (31) 

E[rj {t)r] (OO (OO (0] = P^mj {t)m] {t)m^ (t)m] {t)\ (32) 

E[mj{t)m){t)mj{t)rn](t)yO. (33) 



20 [0055] The third assumption (A3) : The set of source signals (processes) and set of noise 
processes are statistically independent. Assumption A3 is represented mathematically as 
follows. 

M 

fn.r,,,,,.r^\n,.n,.,..^^^ (34) 

[0056] The fourth assumption (A4) : The noise processes are stationary zero-mean 
25 Gaussian random processes. They are not assumed to be spatially or temporally independent. 
Assxunption A3 is mathematically represented as follows. 
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n,it)~NiO,(ri') 

n (0 = [«i (0. riiit), nN(t)]'~N(0,K„) 

1 



-n'K,-'» 



(2;r)'^'|detK, 



i/2 



(35) 
(36) 

(37) 



[0057] The fifth assumption (AS) : The number of sources is less than or equal to the 
number of sensors, i.e. M <N . 

[0058] Figure 5 is a functional block diagram of an apparatus for performing blind source 
separation (BSS) of M statistically independent narrowband source signals given a set of outputs 
fi-om an array of sensors with a relatively small spatial expanse and with an arbitrary and 
unknown array geometry, in accordance with an embodiment of the present invention. The BSS 
technique as described herein determines a separation matrix W that will diagonalize the mixing 
matrix V . This involves finding a NxM separation matrix W , with complex elements Wy , 



W = 



NM 



(38) 



that will diagonalize the mixing matrix, V . That is, a separation matrix W is desired such that 
the product W" V results in a MxM diagonal "loss" matrix with elements Pj . 



W"V = 



A 0 

0 p, 

0 - 



... 0 

■•. 0 

0 



(39) 



[0059] 

result is 



When the separation matrix, W, is applied to the vector of sensor outputs, the 
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y(0 = W«x(f) = W"{Vr(0 + nW} 
= W"Vr(/) + W"n(f) 
>, 0 ••• 0 

0 : 

1 ••. ••. 0 

.0 ••• 0 



(40) 



Pm^m (0. 



+ W"n(0 



and the source signals are separated. For mathematical completeness note that the vector r(/) € 
C^, the vectors x(?),n(0 € C^, and the matrices V,W e C"*^. If the loss matrix is the identity 

matrix, the separation process has captured all of the signal energy illuminating the array thus 
5 guaranteeing that the separated output signal has reached the maximum achievable signal to 
interference plus noise ratio. 

[0060] As developed previously in the narrowband model, the output of each sensor is a 
weighted linear mixture of the independent source signals plus noise. 

^,(0 = Z^/'i(0 + «.W (41) 

10 Applying the separation matrix to the vector of sensor outputs separates the sources. 

y(/) = W"x(r) 

= W»{Vr(r)+ii(^)} (42) 
= W"Vr(f)+W"n(f) 

The y'* element of the separation process output vector, yj (/) , is an estimate of the j"' source 
signal, rj (t) and is the inner product of the j"" column of the separation matrix and the vector of 
sensor outputs. 

15 - . (43) 

M 



[0061] 



Substituting equation (41) into equation (43) yields 
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15 



(44) 



1=1 /=1 



»=1 

N M 



1=1 /=i 

where it is clear there are three distinct terms corresponding to the desired signal, the residual 
interference, and the output noise. Of particular interest in evaluating the performance of 
conmiunications and signal intelligence systems is the second-order moment of each of these 
terms. The second-order moment of the first term is the desired signal output power and is 
defined as 



Sj^E 



1=1 J U=i J 

=zzw;>^.^[o(Oo(o] 



(45) 



N N 



1=1 *= 



Applying assumptions Al and A2, 



1 0 and thus equation (45) becomes 



^y=^ZZw>* 



1=1 t=i 



which can be represented using vector notation as 

Sj =Pj\vJyjyJyVj. 



(46) 



(47) 



(48) 



[0062] The second-order moment of the second term in (44) is the residual interference 
power and is given by 
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= E 



N M 



1=1 /=i 



N M 



1=1 /=i 



N M 



M M 



N N 



(49) 



/=1 mal 
l^j m*j 



(=1 A=l 



However, by assumption Al the signals are statistically independent and therefore 

E[n(t)r:(t)] = 0, formal. 

Additionally, applying the stationarity of assumption Al and assumption A2, 



(50) 



(51) 



Using (50) and substituting equation (51) into equation (49), the residual interference power 
reduces to 

M N N 

which can be represented using vector notation as 

M 



(52) 



[0063] 

is given by 



^j = llPi^>.^>j' (53) 
The second-order moment of the third term in (44) is the output noise power and 



Nj=E 



= E 



1=1 



(54) 



1=1 *=1 



which can be represented using vector notation as 
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' A^y = wy£[n(/)n«(0]w,. (55) 

By definition and assumption A4, the expectation of the outer product of the noise vector is the 
noise covariance matrix, 

E[n{t)n" (t)] = K„ (56) 

5 and thus the output noise power is 

A^,=w;K„w,. (57) 

[0064] To evaluate the effectiveness of a bhnd source separation technique, a measure of 
the quality of the separation is utilized. As previously described, the blind source separation 
technique as described herein determines a separation matrix W that will diagonalize the mixing 
10 matrix V . Two measures to assess the quality of a blind source separation algorithm are 
developed herein. Performance of the BSS technique may be measured in terms of residual 
interference and in terms of the efficiency of the algorithm in "capturing" all available signal 
power illuminating the array of sensors. 

[0065] One measure of the quahty of separation is the amount of residual interference 
1 5 found in a signal output after the separation matrix has been applied. Specifically, the power of 
the residual interference relative to the desired signal in the estimate of the desired source 
averaged over all sources as well as the peak or maximum residual interference-to-signal ratio to 
assess the separation technique in terms of suppressing co-channel interference are proposed for 
use. This measure is of significance because, if the separation matrix does not perfectly 
20 " diagonalize the mixing matrix, the off diagonal terms of the resultant matrix will permit residual 
interference in the signal outputs. 

[0066] In most communications applications, the common measure of the amount of 
interference is the signal-to-interference ratio, which is the ratio of the desired signal power to 
the combined power of all interfering signals. However, as the goal of the blind source 
25 separation is to completely eliminate all interference, this ratio could become extremely large. 
As a result, the Interference-to-Signal ratio (ISR), which quantifies the residual power of the 
interference that a blind source separation algorithm or technique fails to suppress relative to a 
particular desired signal power, is proposed. The better an algorithm is the smaller this ratio will 
become. 

30 [0067] The ISR of a particular desired signal is defined as 

(58) 
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Substituting (53) and (48) into (58), the ISR for a particular signal is 

M 

AwN.v^. ' ^^^^ 

J J J J 

This value is also known as the rejection rate. 

[0068] The overall quality of separation of a bhnd source separation technique may be 
measured by looking at the mean value of the individual source signal ISR's, , over all j , 

Thus the primary measure to be used to evaluate the performance of a blind source separation 
algorithm in terms of residual interference will be the average ISR given by 

(60) 



[0069] The secondary measure in terms of residual interference will be the peak or 
10 maximum ISR, which is defined as 



/5/?_^max[<',]. (61) 



This secondary measure ensures that all source signals are effectively separated with an ISR no 
worst than ISR^ . 

[0070] A second measure of the quality of separation is utilized to determine the 
15 efficiency of the source separation matrix in terms of its ability to make use of the available 

signal power. A BSS technique is considered more efficient if the output signal-to- interference- 
plus-noise ratio is maximized, thus having greater sensitivity in terms of being able to capture 
smaller signals, than a BSS technique not maximizing the output signal-to- interference-plus- 
noise ratio. 

20 [0071] The efficiency of a blind source separation algorithm in using all of a source's 
signal power illimiinating the array of sensors is yet another important measure of its quality of 
separation. This measure determines how much of the available signal power firom a particular 
source is wasted or lost in the separation process. This loss results in a lower signal-to-noise- 
plus-interference ratio then would otherwise be theoretically achievable and thus a loss in system 

25 sensitivity. The Separation Power Efficiency (SPE) for a particular separation process output 
relative to the desired source signal's available normalized power is defined as 

^.^i, where (62) 
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Q is indicative of the separation power efficiency for the j* source of the plurality of sources, Sj 
is indicative of a power of a separated signal from the j* source, and Pj is indicative of a 
normaUze power of a signal from the j* soiu-ce. 

Substituting equation (48) in for the separation process output power reveals that the particular 
5 SPE 

Pj (63) 

depends only on the Steering vector for the y"' source and the /* column of the separation 
matrix. As with ISR, both the average SPE and the minimum SPE, defined as 

10 and 



U^rmn[^j] (65) 



respectively, will be used to evaluate the separation power efficiency. 

[0072] Note that by the definition of the illuminating source signal power, Pj , that the 

maximum value the SPE can achieve is one. Thus the maximum achievable average SPE is also 
15 one. A separation algorithm that achieves an SPE of one is guaranteed to have maximized the 
source signal power in the corresponding separation process output. The minimum SPE provides 
a measure of ensuring that all sources are successfiilly separated with a minimimi separation 
power efficiency. 

[0073] A BSS technique in accordance with an embodiment of the present invention 
20 utilizes cumulants, specifically spatial fourth order cumulant matrices. To better understand the 
use of cimiulants in performing blind source separation, a cumulant definition and associated 
properties are provided below. 

[0074] The joint cumulant, also known as a semi-invariant, of order N of the set of 
random variables {s^,S2y,..,s^] is defined as the N^^ -order coefficient of the Taylor series 

25 expansion about the origin of the second characteristic fiinction. See, for example, C.L. Nikias 
and A.P. Petropulu, Higher-Order Spectra Analysis: A Non-Linear Signal Processing 
Framework, (PTR Prentice-Hall, Upper Saddle River, NJ: 1993) and M. Rosenblatt, Stationary 
Sequences and Random Fields (Birkhauser, Boston, MA: 1985), which are hereby incorporated 
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by reference in their entirety as if presented herein. The second characteristic function is defined 
as the natural logarithm of the characteristic function, 

^. (fy„ <»2 , . . . , cy^ ) = In [O, , . . . , o;^ )] 



where the characteristic function is defined as 

<I).(cy,,^y,,...,fi>^)si:[e^('^^'*'^^'*"*'"''''')]. 

The joint N"" -order cumulant is then 

Cum[s„s„...,s,\ = {-j) ————— 



da^da^ • • • doj^ 



(66) 



(67) 



(68) 



[0075] Cumulants, unlike moments, cannot be directly estimated from the data. See, for 
example, A.K. Nandi, Blind Estimation Using Higher-Order Statistics (Kluwer Academic, 

10 Dordecht, The Netherlands: 1999), which is hereby incorporated by reference in its entirety as if 
presented herein. However, cumulants can be found through their relationship to moments and 
can thus be estimated indirectly by first estimating the required moments. The relationship of 
cumulants to moments is described in M. Rosenblatt, Stationary Sequences and Random Fields 
(Birkhauser, Boston, MA: 1985) for the A^'* -order joint cumulant of the set of random variables 

15 l^pSj,..., 5^} as 



Cum[s,,s,,...,s,] = j;^{-lY-\p-l)\ 



Hp) p 

«=1 /=1 



(69) 



where there are N(p) ways of partitioning the set of integers {1,2,..., AT} into p groups, each 
denoted as g^^^ , such that 



(70) 



/»1 



20 [0076] As an example, for the case AT = 4 , the partitioning is defined on the set of 
integers {1,2,3,4} and is given in Table 1.0 below. 
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Table 1.0: All Possible Partitions for N = 4 



p 


Hp) 




1 


1 


{1,2,3.4} 






{1}{2,3,4};{2}{1,3,4};{3}{1,2.4};{4}{1,2,3}; 


2 


7 


{l,2}j3,4};{l,3}{2,4};{l,4}{2,3} 






{1}{2}{3.4};{1}{3}{2,4}:{1}|4}{2,3}; 


3 


6 


{2){3}{1.4};{2}{4}{1,3};{3H4}|1,2} 


4 


1 





The 4 -order joint cumulant as a function of the moments is then 

Cum [j,, , ^3 , J4 ] = £ [s^s^s^s^ ]-E[s^]E [s^s^s^ ] - £ [ ] • £ [5,53^4 ] 

-E [s^]'E [s^s^s^ ] - £ ] • £ [5, Jj53 ] - £ ] • £ [ J3 J4 ] 

-E[s,s,]E[s,s,]-E[s,s,]E[s,s,] + 2E[s,s,]E[s,]E[s,] 
+2E[s,s,]E[s,]E[s,]+2E[s,s,]E[s,]E[s,] 
+2E[s2S,]E[s^]E[s^]+2E[s^s,]E[si]E[s,] 
+2E[s,s,]E[s,]E[s,]-6Els,]E[s,]E[s,]E[s,] 

5 Note that equation (71) shows that computation of the N^^'-order joint cumulant requires 
knowledge of all moments up to order N . 

[0077] Cumulants possess several properties that make them attractive for use in the 
blind separation of a linear mixture of unknown statistically independent signals in spatially 
and/or temporally correlated Gaussian noise, especially at a low signal-to-noise ratio. 

10 [0078] One property that makes cumulants attractive for use in blind source separation is 
that if the set of random variables {5, , , . . . , } can be divided in to two or more groups that are 

statistically independent, then their N^^ -order joint cumulant is zero. Thus, the cumulant 
operator in the blind separation of statistically independent sources will suppress all cross-source 
signal cumulant terms. In general, this is not the case for higher-order moments. Another 
1 5 property that makes cumulants attractive for use in BSS is that the 

Cum[s, •f Wp^j + AJ2>- • •j'^A^ "'"'^jv] — C'ww[5,,iy2J"M'^A^]'*"^w/w[/ij,W2,...,Wyy]. Bccausc in general 
the set of signal terms { , ^2 , . . . , 5^ } and the set of noise terms { Wp > • • • > '^at } ^® statistically 
independent from each other, the N"" -order joint cumulant of the terms of their vector sum. 
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{5, + «, , ^2 + n2 . . , + % } , is the sum of their individual joint cumulants. Therefore, the cross 

cumulants between the noise terms and signal terms will be zero. This property is important in 
guaranteeing that the spatial fourth-order cumulant matrix can be decomposed into the sum of 
two matrices, one corresponding to the signals and the other corresponding to noise vector. 

5 [0080] Yet another property that makes cumulants attractive for use in BSS is that the 
joint cumulant of order N>2 of a Gaussian random variable is zero. Because the noise vector is a 
multi-variate Gaussian random process, n = |'/2,,/i2 v-j'^jvT ^{Vn^^n)^ its joint cumulant of 
order three or higher will be zero. That is Cum [n^ , /I2 , . • • ? ^^^^ ] = 0 . This last property results in 

the spatial fourth-order cumulant matrix not having a noise subspace and the only non-zero 
10 elements of the matrix are associated with and only with the source signals. This is true even if 
the noise vector is spatially or temporally correlated. 

[0081 ] Finally, cumulants of order higher than two preserve phase information that is lost 
by the use of second-order statistics, such as correlation. For example, auto-correlation destroys 
the information necessary to distinguish between minimum phase and non-minimum phase 

15 . signals. Thus, two signals may have identical second-order statistics yet have different higher- 
order statistics. This property is of particular interest in handling signals with identical auto- 
correlation functions and adds additional degrees of freedom for finding a set of time lags where 
a group of source signals will have different higher-order cumulants. This property is 
particularly advantageous to a BSS technique in accordance with the present invention because a 

20 condition of identifiability of this BSS technique is that all signals have a unique normalized 
fourth-order auto-cumulant. Note that the fourth-order cumulant is used because odd order 
cumulants of a process with a symmetric distribution will be zero. 

[0082] Four properties of cumulants utilized in the BSS technique in accordance with the 
present invention are described below. Proofs of these cumulant properties may be foimd in C.L. 
25 Nikias and A.P. Petropulu, Higher-Order Spectra Analysis: A Non-Linear Signal Processing 
Framework. (PTR Prentice-Hall, Upper Saddle River, NJ: 1993) and M. Rosenblatt, Stationary 
Sequences and Random Fields (Birkhauser, Boston, MA: 1985). 

[0083] Cumulant Propertvl : 

The A/^'* order joint cumulant of the set of random variables {a^s^,a2S2y,..,af^Sj^} is 
30 Cww[ai5pa2'^2»'*-'^Ar'^^] = |n^»^|^ where {a^,a2,...,af^}diK constants. 

[0084] Cumulant Pronertv 2 : 
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If the set of random variables { , , . . . , 5^ } can be divided in to two or more groups that 
are statistically independent, then their iV^* -order joint cumulant is zero. 
[0085] Cumulant Property 3 : 

If the sets of random variables {s^,s2,...,s^} and {nj^Wj,...,/!^} are statistically 
5 independent, i.e. f^^(s^,S2,...,s^,n^,n2,...,nf^) = f^{s^,S2y...,^ 
TV'* -order joint cumulant of the pair-wise sum is 
Cum[s^ -^n^,S2 +W2,...,5'^ +«;^] = CMm[5p52,...,5^]^-Cww[«J,n2J-•,%]• 
[0086] Cumulant Property 4 : 

If the set of random variables { «j , «2 ^ • • > '^/v } ^1*^ J ointly Gaussian, then the j oint cumulants 

10 of order A/^ > 2 are identically zero. That is, if n = [n^ • ^^nV ^ then 
Cum [«p«2>-">'^A^]-0. 

[0087] A BSS technique in accordance with the present invention utilizes a fourth order 
spatial cumulant matrix. Three definitions of the spatial fourth-order cumulant matrix and 
associated properties are provided below, 

15 [0088] The spatial fourth-order cumulant matrix is used as a basis for estimating a 
separation matrix at low signal-to-noise ratios and in the presence of spatially and temporally 
correlated noise since it theoretically has no noise subspace, even if the noise is correlated. This 
eliminates the need to use either degrees of freedom and/or secondary sensor data to estimate the 
noise subspace, which must be removed in order for the matrix-pencil to be formed. As 

20 described below, the absence of the noise subspace is a direct result of using a higher-order 

cumulant, i.e. order > 2, and is particularly advantageous to a blind source separation technique 
in accordance with the present invention. 

[0089] The three spatial fourth-order cumulant matrix definitions and their properties are 
presented herein with consideration of the fact that the sensors are in reality never omni- 

25 directional, never have identical manifolds, and that different sets of time lags are needed to 
estimate a pair of spatial fourth-order cumulant matrices to form the matrix-pencil. These 
considerations are a clear distinction from previous treatments of the spatial fourth-order 
cumulant matrix. See, for example, H.H. Chiang and C.L. Nikias, "The ESPRIT Algorithm with 
Higher-Order Statistics," Proc. Workshop on Higher-Order Spectral Analysis, Vail, CO., Jun. 

30 1989, pp. 163-168, C.L. Nikias, C.L. Nikias and A.P. Petropulu, Higher-Order Spectra Analysis: 
A Non-Linear Signal Processing Framework (PTR Prentice-Hall, Upper Saddle River, NJ: 
1993), M.C. Dogan and J.M. Mendel, "Applications of Cumulants to Array Processing - Part I: 
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Aperture Extension and Array Calibration," /ESS Trans, Signal Processing, Vol. 43, No. 5, May 
1995, pp. 1200-1216, and N. Yuen and B. Friedlander, "Asymptotic Performance Analysis of 
ESPRIT, Higher-order ESPRIT, and Virtual ESPRIT Algorithms," IEEE Trans, Signal 
Processing, Vol. 44, No, 10, Oct. 1996, pp. 2537-2550. Understanding the properties of the 
5 spatial fourth-order cumulant matrix such as its rank, null spaces, etc., and its relationship to the 
mixing matrix are beneficial to developing a signal subspace blind separation technique using 
fourth-order cumulants and a matrix-pencil in accordance with the present invention. 

[0090] A brief review of the spatial correlation matrix and its properties are provided 
below to aid in understand its use in a BSS technique in accordance with the present invention. 
10 The spatial correlation matrix of the sensor array output is defined in D.H. Johnson and D.E. 
Dudgeon, Array Signal Processing: Concepts and Techniques, (PTR Prentice-Hall, Englewood 
Cliffs, NJ: 1993), which is hereby incorporated by reference in its entirety as if presented herein, 
as: 

R,(r) = £[x(Ox"(/-r)] (72) 

15 Substituting (25) for x(/) in to equation (72) and applying assumptions Al and A3, the spatial 
correlation matrix becomes 

R,(r) = £[{Vr(0 + n(0}{VrO-r) + n(/-r)}"] 

= £ [ Vr ) r" - r) V" ] + £ [ Vr (/) n" (f - r)] 
+£[ii(Or"(f-r)V"] + £[nWii"(/-r)] (73) 
= V£[r(f)r«(i-r)]v"+£[iiWn"(^-r)] 
= VR,(r)V"+R„(r) 

which has elements 

[R. (^)L = hi^'A'j (Oo -^)] + ^[«. (0 «: {t-r)] (74) 

20 where the subscript rc indicates the element is in the r'^ row and c'* column. Since the signal 
and noise processes are assumed to be zero mean, assumptions A2 and A4, the spatial 
correlation matrix defined in equation (72) is equivalent to the spatial covariance matrix, and 
thus the terms are used interchangeably. 

[0091] In general, most second-order techniques make use of the spatial correlation or 
25 covariance matrix only at a delay lag of zero, {r = 0} . In such a case the spatial correlation 

matrix is Hermitian and non-negative definite. See for example D.H. Johnson and D.E. 
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Dudgeon, Array Signal Processing: Concepts and Techniques. (PTR Prentice-Hall, Englewood 
Cliffs, NJ: 1993), C.L. Nikias and A.P. Petropulu, Higher-Order Spectra Analysis: A Non-Linear 
Signal Processing Framework. (PTR Prentice-Hall, Upper Saddle River, NJ: 1993), and A. 
Papoulis, Probability, Random Variables, and Stochastic Processes. (WCB/McGraw-Hill, 
5 Boston, MA: 1991), for example. Further, if the sensor outputs are linearly independent, that is 
E l^ja^x (/)} ja^x (/)}* j > 0 for any a = [a,, , . . . , f ?^ 0 , then the spatial correlation matrix is 

positive definite. As a consequence of the spatial correlation matrix being non-negative definite 
for r = 0, its determinant will be real and non-negative, and will be strictly positive if and only if 
the sensor outputs are linearly independent. However, if r^O then the spatial covariance matrix 
10 is indefinite and non-Hermitian. 

[0092] Spatial Fourth-Order Cumulant Matrix Definition 1 

The first definition of a spatial fourth-order cumulant matrix presented takes advantage of the 
steering vectors having a norm of one. This is stated mathematically in equation (26). As will 
be shown, this is utilized to factor the spatial fourth-order cimiulant matrix into Hermitian form 
15 when the sensors are not onmi-directional with identical manifolds. The first spatial fourth-order 
cumulant matrix is defined at the set of time lags (r, , , ) as 

C^(ri,r2,T3)^2]c«m[x;(?-T0x,(/-r2)x(r)x«(r-r3)] (75) 

i=\ 

and is referred to as spatial fourth-order cumulant matrix 1. 



20 [0093] The spatial fourth-order cumulant matrix 1 as defined in (75) is in general a 
complex NxN matrix with the element in the r'* row and c'* column given by 

[C:(^..r,.r3)]^=2;c«/n[x;(/-r,)x,(/-r3);c,(0<(^-r3)] (76) 

1=1 

where { }* denotes complex conjugation. Substituting equation (24) into (76), element rc 
becomes 



25 



[c:(rpr„r3)]^^=|;Ci.m 

/=i 



(77) 
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Then, by Cumulant Property 3 and assumption A3, (77) becomes 



1=1 
M 



M 

m=l 

1=1 

where the terms have been re-ordered. However, by assumption A4 and Cumulant Property 4, 
XCwm[«,(0«;(r-rO«,(/-r2)w;(r-r3)] = 0 (79) 

and thus (78) becomes 

N lU Lf u 

1=1 
M 



M 

/=1 



(78) 



/=! 



m=l 



(80) 



Then, by the source signals statistical independence of assumption Al and repeatedly applying 
Cumulant Property 3, equation (80) reduces to 



[c'A^.r,,T,)l^=±±Cum[v,r.(^^^^^^ (81) 

1=1 y=l 

10 [0094] Using Cumulant Property 1 , the complex weights may then be pulled out in front 
of the cumulant operator in equation (81) to give 



[ct{r^,T,,r,)l^=^^ (82) 

/=1 7=1 

Reordering the summation yields 

(83) 

7=1 1=1 

N N 

1 5 However, since the steering vectors have a norm of 1 , that is ^ v*jVy = ^al =l, equation (83) 

j=i /=i 

reduces 

M 

[cHr,,r3.r3)]^ = Xv,XC"'«bW';('-^.)0('-^2)0(^-^3)]- (84) 
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[0095] From (84) it can be seen that spatial fourth-order cumulant matrix 1 can be 
factored into Hermitian form, as was the case for spatial correlation matrix, 

C:(r„r„r3) = VC;(r.,r„r3)V« (85) 
where (^,,72,^3) is a MxM diagonal matrix with elements, 

U \ ' ^^^^ 

Expanding equation (85) it is found that spatial fourth-order cumulant matrix 1 can be written as 
a sum of the steering vector outer products scaled by the individual source signal's fourth-order 
cumulant. 

Cx (^P ^2 > ^3 ) = E (^1 . ^2 . ^3 ) Vy V? , where (87) 

10 (r, , , T3 ) is the spatial fourth order cimiulant matrix having a first time lag, xi , a second time 
lag, T2, and a third time lag, X3, each time lag being indicative of a time delay firom one of the 
plurality of sources to one of the plurality of elements; M is indicative of a number of sources in 
the plurality of sources; c^^ (r, ,72,^3) is a fourth order cumulant of a j^** source signal from one of 

the plurality of sources having delay lags xi, X2, and X3; and v? is indicative of an outer 
1 5 product of a steering vector. 

From equation (87) it is clear that spatial fourth-order cumulant matrix 1 lies in the signal 
subspace spanned by the set of steering vectors. Note that the spatial fourth-order cimiulant 
matrix does not have the noise subspace that is present in the spatial correlation matrix. What 
was the noise subspace in the spatial covariance matrix is now the nullspace of the spatial fourth- 
20 order cumulant matrix. This property will be shown to be true for the other spatial fourth-order 
cumulant matrix definitions presented. 

[0096] Spatial Fourth-Order Cumulant Matrix 1 Properties 

Spatial fourth-order cumulant matrix I, CI{t^,t2,t^) , has several properties, an understanding 

of which will facilitate the development of a method for estimating a separation matrix W . 
25 Establishing the spatial fourth-order cumulant matrix 1 's matrix properties is a first step to the 
use of the generalized eigen decomposition of the matrix-pencil formed by a pair of spatial 
fourth-order cumulant matrix I's at two sets of time lags. Such things as its rank and its 
subspaces relationships to the mixing matrix's subspaces are advantageous in developing a signal 
subspace separation algorithm. Particular attention is paid to the fact the individual sensors are 
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not assumed to be omni-directional with identical directivity for each impinging source signal 
wavefield. 

[0097] Property 1 : Spatial fourth-order cumulant matrix 1 is Hermitian if and only if 
7^=^2=7 andrj =0, i.e. C^(r,r,0). 

5 [0098] Property 2 : The trace of spatial fourth-order cumulant matrix 1 equals the sum of 
the signal fourth-order cumulants, which is the trace of the diagonal matrix (^p^i^^a) • 

tr(cl {t,,t^.t,)) = ;^cj (r„r2,r3) ^^^^ 

[0099] Property 3 : The column space of spatial fourth-order cumulant matrix 1, denoted 
as C (C^Ti , , )) , is spanned by the set of steering vectors. 

10 ^/^(C(c:(rpr2,r3))) = {v,,v2,...,v^} (89) 

Further, if the mixing matrix has full column rank, then the set of steering vectors are linearly 
independent and they form a basis for the colunrn space of spatial fourth-order cumulant matrix 
1. 

[01 00] Property 4 : If V has full column rank, then the rank of spatial fourth-order 
15 cumulant matrix 1 equals the rank of the mixing matrix. That is 

p(Cl{T„T„T,)) = p(y) (90) 

if p{y) = M , where p{ ) denotes rank. 

[01 01] Property 5 : The "right" nuUspace of spatial fourth-order cumulant matrix 1 and 
the "left" nuUspace of the mixing matrix are equal if the mixing matrix has full column rank. 

20 A^.(c:(r,,r2,r3)) = iV,(V) (91) 

[0102] S patial Fourth-Order Cumulant Matrix Definition 2 

The second definition for a spatial fourth fourth-order cumulant matrix is one modified from the 
definition described in H.H. Chiang and C.L. Nikias, "The ESPRIT Algorithm with Higher- 
Order Statistics," Proc. Workshop on Higher-Order Spectral Analysis, Vail, CO., Jun. 1989, pp. 
25 163-168 and C.L. Nikias and A.P. Petropulu, Higher-Order Spectra Analysis: A Non-Linear 
Signal Processing Framework, (PTR Prentice-Hall, Upper Saddle River, NJ: 1993). These 
definitions are used and the set of time lags {T^9T2yT^) are incorporated to obtain spatial fourth- 
order cumulant matrix 2. 
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15 



C:'(r,.r„r3) = C«/n[{x(0x (f-r,)x(/-r3)}x"(?-T3)] 



(92) 



[01 03] Spatial fourth-order cumulant matrix 2 is diNxN matrix with the element in the 
r'* row and c** column 

[c:'(rpr„r3)j =Cum[x,(t)x:{t-T,)x,(t-T,)xl{t-z,)\. (93) 
Substituting equation (24) for ;t, {t) in equation (93), element rc becomes 



[c:'(r,.r,.r3) 



= Cum 



M 



(94) 



Following the simplification of spatial fourth-order cumulant matrix 1, Cumulant Property 3 and 
assumption A3 are applied to reduce equation (94). 



C;l'(r„z-2,T3) =Cum 

L Jrc 



MM M 
Jfc=l 



,>1 



/=1 



m=l 

+Cum[n,(t)n;{t-T,)n^(t-T,)nl{t-T,)] 

10 However, by assumption A4 and Cumulant Property 4, 

Cum[n^{t)n;{t-T,)n^{t-r,)nl{t-T,)] = 0 

and thus (95) reduces to 



(95) 



(96) 



|^cf(r„r2,r3) 



= Cum 



MM M 

1=1 t=i 1=1 



M 



(97) 



Then, by the statistical independence of the source signals of assumption Al and repeatedly 
applying Cumulant Property 3, equation (97) reduces to 



" ' 1 ^ r "I 



(98) 
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[0 1 04] Using Cumulant Property 1 , the complex weights may then be pulled out in fiont 
of the cumulant operator in equation (98) to give 

' 1 ^ 



[• 



Jrc j=\ 

-2 



However, v^v*. = and equation (99) reduces 
5 [c:'(r„r„r3)l =f,cxlv,v:jCum[rj{^^^^ (100) 

L J re 7=1 

[01 05] From (100) it can be seen that spatial fourth-order cumulant matrix 2 in general 
can not be factored into Hermitian form, as was the case for spatial fourth-order cumulant matrix 
1 and the spatial covariance matrix. However, if 

v^.^ajv^. (101) 

10 is defined, it can be factored in to bilinear form. 

c:'(Tpr„r3) = VC;(r„r„r3)V" (102) 

where the element in the row and c'^ column of the NxM "modified" mixing matrix V is 

[VL=V„. (103) 

Expanding equation (102), it is found that spatial fourth-order cumulant matrix 2 can be written 
15 as a sum of the outer products of the "modified" steering vector, v^. , and steering vector scaled 

by the individual source signal's fourth-order cumulant. 

C:'(r„r„r3) = |;cJ(rpr2,r3)v; (104) 
Note that the "modified" steering vector Vj is the y'* column of the matrix V . 

[01 06] A question pertaining to spatial fourth-order cumulant matrix 2 is whether or not 
20 it is rank deficient. Following the derivation of the rank of spatial fourth-order cumulant matrix 
1, the rank of spatial fourth-order cumulant matrix 2 will be equal to the rank of the mixing 
matrix if "modified" mixing matrix, V , and the mixing matrix both have full column rank. The 
mixing matrix V can be assumed to have full column rank since this can be guaranteed by design 
of the array. However, the rank of V cannot be guaranteed by design and as of yet, it is unclear 
25 if guaranteeing that the mixing matrix has full column rank is sufficient to guarantee that the 
"modified" mixing matrix will have full colunm rank. Although the "modified" mixing 
matrix V is the Hadamard product 
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V= V© V© V (105) 

the rank of the mixing matrix is not necessarily preserved. See for example, J. R. Schott, Matrix 
Analysis for Statistics. (John Wiley and Sons, New York, NY: 1997). At this point it shall be 
assumed that the Hadamard product preserves the rank of the mixing matrix and therefore that 
5 the mixing matrix having full column rank is sufficient to guarantee that the "modified" mixing 
matrix has full column rank. The implications of the "modified" mixing matrix not having full 
colunm rank will be clear in the subsequent sections. 

[01 07] If the "modified" mixing matrix has full colunm rank, by inspection of equation 
(104) it is obvious that spatial fourth-order cimiulant matrix 2 lies in the signal subspace spanned 

10 by the set of "modified" steering vectors. Again, the noise subspace in the spatial covariance 
matrix is now a nuUspace of spatial fourth-order cumulant matrix 2. Note that in H.H. Chiang 
and ex. Nikias, "The ESPRIT Algorithm with Higher-Order Statistics," Proc. Workshop on 
Higher-Order Spectral Analysis, Vail, CO., Jun. 1989, pp. 163-168 and C.L. Nikias and A.P. 
^Petropulu, Higher-Order Spectra Analysis: A Non-Linear Signal Processing Framework. (PTR 

1 5 Prentice-Hall, Upper Saddle River, NJ: 1993), the elements/sensors are omni-directional with 
unit gain so that afj = 1 and as such, spatial fourth-order cumulant matrix 2 and spatial fourth- 
order cumulant matrix 1 would be equal and the "modified" mixing matrix has full column rank. 
However, this is an unrealistic assumption since in practice sensors are never omni-directional. 

[0108] Spatial Fourth-Order Cumulant Matrix 2 Properties 

20 If the "modified" mixing matrix V has full column rank, spatial fourth-order cumulant 

matrix 2 will possess many of the same properties that spatial fourth-order cumulant matrix 1 
does. The subsequent sections derive the key properties associated with the development of a 
matrix-pencil signal subspace separation technique with the assumption that the "modified" 
mixing matrix has full colimin rank. 

25 [0109] Propertv 1 

Spatial fourth-order cumulant matrix 2 is in general non-Hermitian. It will be Hermitian 
if and only if r, = = r andrj = 0 , i.e. cf (r,r,0) and the sensors all have the identical gain for 
a given signal. 
[0110] Property 2 

30 The trace of spatial fourth-order cumulant matrix 2 equals the sum of the signal fourth- 

order cxmiulants scaled by the sum of the sensor magnitudes to the fourth power. 
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M N 



(106) 



>1 r=l 



[0111] Property 3 

The column space of spatial fourth-order cumulant matrix 2, denoted as 
cicl (r, , , ^3 ) L is spanned by the set of "modified" steering vectors. 



sp 

\ 



c(^cf(r,,r2,r3)jj = {v,,V2,...,v^} (107) 



Further, if the "modified" mixing matrix has full column rank, then the set of "modified" 
steering vectors are linearly independent and they form a basis for the column space of spatial 
fourth-order cumulant matrix 2. 

10 [0112] Property 4 

The rank of spatial fourth-order cumulant matrix 2 equals the rank of the mixing matrix, 
if V and V have fall column rank. That is 

p[c'^ {T„T„T,)y p{V) (108) 

if /?(¥) = p{y) = M , where p[ ) denotes rank. 

15 [0113] Property 5 

The "righf nullspace of spatial fourth-order cumulant matrix 2 and the "left" nuUspace 
of the mixing matrix are equal if the mixing matrix and "modified" mixing matrix have fall 
column rank. 

^.(c:'(rpr„r3)j = Ar,(V) (109) 

20 [Oil 4] Spatial Fourth-Order Cumulant Matrix Definition 3 

The third and final definition for a spatial fourth-order cumulant matrix incorporates the 
time lags {t^,T2,t^) and results in the following equation. 

Cf (rpT2,r3)^Cwm[{x(0x (^-r^x (r-r,)}x^(?-r3)] (HO) 

[0115] Spatial fourth-order cumulant matrix 3 is again ^NxN matrix with the element in ^ 
25 the row and c'* column 
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10 



^1 (^vh'h) =Cum[x^{t)x;{t-T^)x;{t-r2)x^{t-r3)]. 



Substituting equation (81) for ac, (/) in equation (1 1 1), element rc becomes 



(111) 



= Cum 



f M Xf'^ 



(112) 



Following the simplification of spatial fourth-order cumulant matrix 2, Cumulant Property 3 and 
assumption A3 are applied to reduce equation (112). 



Ev7WZv>;(r-r.)Ev>;(/-^.) 



M 



l^cf (r,,r2,r3)j =Cum 

M 

+Cum \n^{t) «; {t-T,) «; (r - ) (/ - z, )] 

However, by assimiption A4 and Cumulant Property 4, 

Cum[n,{t)n:{t-T,)n:(t-T,)n,{t-r,)\ = 0 (1.1) 

and thus (95) reduces to 



(113) 



M 



Z ^rj^} (OS - ^1 )Z " ^2 ) 



= Cmw 



(114) 



Then, by the statistical independence of the source signals of assxmiption Al and repeatedly 
applying Cumulant Property 3, equation (1 14) reduces to 

Cf (r„r„r3)l =|;Cum[v^.r,(0v;.r,r(f-r,)v;r,(/-r,)v,/,(r-r3)'] . (115) 



rc }-\ 



[0116] Using Cumulant Property 1, the complex weights may then be pulled out in front 
15 of the cumulant operator in equation (1 15) to give 



However, v^^v* = a]^ and equation (116) reduces 



(116) 
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ff ~\ M 

J re y=i 

[01 17] From (1 17) it can be seen that spatial fourth-order cumulant matrix 3 in general 
can not be factored into Hermitian form, as was the case for spatial fourth-order cumulant matrix 
1 and the spatial covariance matrix. However, if the "modified" steering vector elements are 
5 again defined as 

v^-«X- (118) 

it can be factored in to bilinear form. 

Cf (r„r„r3) = V*c:(T„T„r3)V^ (119) 

where the element in the r'* row and c'* column of the NxM "modified" mixing matrix V is 
10 [VL=V„. (1.2) 

Expanding equation (119), it is found that spatial fourth-order cumulant matrix 3 can be written 
as a sum of the outer products of the conjugate of the "modified" steering vector, v^. , and 

steering vector scaled by the individual source signal's fourth-order cumulant. 

Cf(r„r„r3) = |;c;(r„r„r3)v;.v} (120) 

15 [0118] As before, it is yet to be proven if the mixing matrix V having full column rank is 
sufficient to guarantee that the "modified'' mixing matrix V will have full column rank. 
However, it shall be assumed that the Hadamard product preserves the rank of the mixing matrix 
and therefore that the mixing matrix having full column rank is sufficient to guarantee that the 
"modified" mixing matrix has full column rank. 

20 [Oil 9] If the "modified" mixing matrix has full column rank, by inspection of equation 
(120) it is clear that spatial fourth-order cumulant matrix 3 lies in the signal subspace spanned by 
the set of conjugated "modified" steering vectors. Again, like spatial fourth-order cumulant 
matrix 2, spatial fourth-order cumulant matrix 3 has no noise subspace. Note that in N. Yuen 
and B. Friedlander, "Asymptotic Performance Analysis of ESPRIT, Higher-order ESPRIT, and 

25 Virtual ESPRIT Algorithms," IEEE Trans. Signal Processing, Vol. 44, No. 10, Oct. 1996, pp. 
2537-2550, as in H.H. Chiang and C.L. Nikias, "The ESPRIT Algorithm with Higher-Order 
Statistics," Proa Workshop on Higher-Order Spectral Analysis, Vail, CO., Jun. 1989, pp. 163- 
168 and C.L. Nikias and A.P. Petropulu, Higher-Order Spectra Analysis: A Non-Linear Signal 
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Processing Framework. (PTR Prentice-Hall, Upper Saddle River, NJ: 1993), the 
elements/sensors are assumed to be omni-directional with unit gain so that ccfj^l. 

[0120] Spatial Fourth-Order Cumulant Matrix 3 Properties 

As with spatial fourth-order cumulant matrix 2, if the "modified" mixing matrix V has full 
5 column rank, spatial fourth-order cumulant matrix 3 will have many properties in common with 
spatial fourth-order cumulant matrix 1. Properties associated with the development of a matrix- 
pencil and the associated separation technique with the assumption that the "modified" mixing 
matrix has full column rank are derived below. 

[0121] Property 1 : Spatial fourth-order cumulant matrix 3 is in general non-Hermitian. 
10 It will be Hermitian if and only if r, = ^3 = r andrj = 0 , i.e. cf (r,0,r) and the sensors all have 
the identical gain for a given signal. 

[01 22] Property 2 : The trace of spatial fourth-order cumulant matrix 3 equals the sum of 
the signal fourth-order cumulants scaled by the sum of the sensor magnitudes to the fourth 
power. 

15 tr[c';: {t,,t,,t,^^ (121) 

[01 23] Property 3 : The column space of spatial fourth-order cumulant matrix 3, denoted 
as C ^C^ (^p^2»^3)j » is spanned by the set of conjugated "modified" steering vectors. 

cfcf (r,,r,,r3)ll = {v;,v;,...,v;,} (122) 



r 

sp 



V 



Further, if the "modified" mixing matrix has full colimm rank, then the set of conjugated 
20 "modified" steering vectors are linearly independent and they form a basis for the colunm space 
of spatial fourth-order cumulant matrix 3. 

[01 24] Property 4 : The rank of spatial fourth-order cumulant matrix 3 equals the rank of 
the mixing matrix, if V and V have full column rank. That is 

p[cf(r„r„T3)j = (123) 
25 if /?(V) = p(v) = M, where p( ) denotes rank. 
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[01 25] Property 5 : The "right" nullspace of spatial fourth-order cumulant matrix 3 and 
the conjugate of the "left" nullspace of the mixing matrix are equal if the mixing matrix and 
"modified" mixing matrix have full column rank. 




5 [0126] 



The three definitions of the spatial fourth-order cumulant matrix presented all 



have the key attribute that they have no noise subspace. This feature allows us to avoid either 
having to use degrees of freedom in the array to estimate the noise subspace or having to make 
an assumption of temporal whiteness so the noise subspace will be gone at non-zero time lags. 
However, there are two main differences between definition 1 and definitions 2 and 3. 



can be seen by comparing equation (76) with equations (93) and (111) where definitions 2 and 3 
require cumulants to be estimated while definition 1 requires cumulants to be estimated. 
Second, while it remains to be rigorously proven that spatial fourth-order cumulant matrix 1 will 
have a rank equal to the number of signals if the mixing matrix has full column rank, it has not 

1 5 been proven that spatial fourth-order cumulant matrices 2 and 3 will have a rank equal to the 
number of signals if the mixing matrix has full colxmm rank. This second difference arises from 
the fact that no proof that the Hadamard product preserves rank has been found. Therefore, it is 
assumed that for the special case of the "modified" mixing matrix it does and thus spatial fourth- 
order cumulant matrices 2 and 3 possess the derived set of properties needed to perform the blind 

20 source separation. However, if this assumption tums out not to be true, then unless the sensors in 
the array have identical manifolds, spatial fourth-order cumulant matrix 2 or 3 may not possess 
enough degrees of fi^eedom to perform the separation. 

[01 28] When the sensors in the array all have identical manifolds, the magnitude of the 
sensors' response, |v^.| = , is a constant for each signal, that is 



10 [0127] 



First, definitions 2 and 3 have a computational advantage over definition 1. This 



25 



(125) 



From equation (26) 



N 



(126) 



which, when all the sensors have identical manifolds, says that (125) can be substituted in to 
equation (126) to get 



30. 



(127) 
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and thus 



Further, if the manifolds are identical then 



a,-^ (.29) 



for all j . Thus, for spatial fourth-order cumulant matrix 2 it was found that when the sensors 
have identical manifolds, substituting (129) in to equation (100) and factoring in to bilinear form 
leads to 



cf(r.,r,.r3) = ^VC:(T,.r„r3)V" 



^ (130) 

and therefore spatial fourth-order cumulant matrix 2 and spatial fourth-order cumulant matrix 1 
10 are equivalent within a real scale factor. Following the identical path for spatial fourth-order 
cumulant matrix 3, one can find that 



Cf(rpr„r3) = lvc:(r,,r„r3)v^ 



^ (131) 
= —Cf(rp 73,73) 

and therefore when the sensors have identical manifolds, spatial fourth-order cumulant matrix 3 
is equivalent to the conjugate of spatial fourth-order cumulant matrix 1 within a real scale factor. 
15 Unfortunately, the assumption that all sensors have an identical spatial response is physically 
unreahzable and proves to be the imdoing of the ESPRIT algorithm and its higher-order 
counterparts. 

[0129] Finally, in N. Yuen and B. Friedlander, "Asymptotic Performance Analysis of 
ESPRIT, Higher-order ESPRIT, and Virtual ESPRIT Algorithms," IEEE Trans. Signal 

20 Processings Vol. 44, No. 10, Oct. 1996, pp. 2537-2550, it is claimed that the advantage of 

definition 3 over definition 2 is that when finite length data is used to estimate the spatial fourth- 
order cumulant matrix, spatial fourth-order cumulant matrix 3 will retain its Hermitian 
symmetry, subject to the conditions stated in property 1 . This property is not known to be of 
value to the matrix-pencil approach presented in the subsequent chapters and thus has not been 

25 evaluated for its validity. 
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[01 30] Provided below are a spatial fourth-order cumulant matrix pencil definition and 
associated properties. The indeterminacy of the standard eigen analysis of a spatial fourth-order 
cumulant matrix is described to motivate the use of a spatial fourth-order cumulant matrix-pencil 
by showing. The definition, properties, and spectral theory of matrix-pencils are presented 
5 including treatment of singular pencils and development of the novel concept of wide sense 
equivalence. The spatial fourth-order cumulant matrix-pencil is defined and its properties are 
derived for all three spatial fourth-order cumulant matrix definitions. Finally, it is shown that the 
spectral analysis of the spatial fourth-order cumulant matrix-pencil provides a set of generalized 
eigenvectors that can be used as a basis for blindly separating the individual source signals. 

10 [0131] The formulation of a separation matrix to perform blind source includes finding a 
set of vectors that are each uniquely orthogonal to all steering vectors except one. The set of 
these vectors, possibly scaled by a normalization factor, form the columns of the separation 
matrix W that will diagonalize the mixing matrix V . The concept of blind source separation 
was previously described above, and the development of a technique to find a separation matrix 

1 5 using a spatial fourth-order cumulant matrix is provided below. 

[01 32] A spatial fourth-order cumulant matrix signal subspace based spectral estimation 
technique is sought to perform the blind separation. In the context of a matrix subspace, spectral 
estimation implies eigen analysis and as such the terms spectral and eigen will be used 
interchangeably. In mathematics, eigenvalues are also often referred to as proper values. See, 

20 for example, P. R. Halmos, Finite-Dimensional Vector Spaces. (Springer- Verlag, New York, 
NY: 1987), which is hereby incorporated by reference in its entirety as if presented herein. 
Unfortunately, in general the standard spectral decomposition of the spatial foxuth-order 
cumulant matrix will not directly provide a set of eigenvectors that will diagonalize the mixing 
matrix. A set of eigenvectors for the spatial fourth-order cumulant matrix does exist that will 

25 diagonalize the mixing matrix, however the entire signal subspace would have to be searched to 
find this unique set of eigenvectors. Thus, the standard eigen decomposition of the spatial 
fourth-order cumulant matrix possesses an indeterminacy that makes it undesirable. The 
indeterminacy of the standard eigen analysis is discussed in Section 5.2 in detail. 

[01 33] The indeterminacy of the standard eigen decomposition can be overcome by the 
30 use of the generalized eigen analysis of a spatial fourth-order cumulant matrix-pencil. Therefore, 
a spatial fourth cumulant matrix-pencil of two spatial fourth-order cumulant matrices is defined 
by using two different sets of time lags, (0, 0, 0) and (r,, , 73 ) . 

[01 34] Indeterminacv of the Standard Eigen Analvsis : The formulation of a signal 
subspace based spectral estimation method to blindly separate the mixture of statistically 
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independent source signals is begun by examining the indeterminacy that exists in trying to use 
the standard eigenvectors of spatial fourth-order cumulant matrix 1, C^rj,r2,r3) , to perform the 

blind source separation. In general, the results presented for spatial fourth-order cumulant matrix 
1 are directly applicable to spatial fourth-order cumulant matrices 2 and 3 and thus will be 
5 presented for spatial fourth-order cumulant matrix 1 only. However, any differences or 

exceptions that may exist for spatial fourth-order cumulant matrices 2 and 3 will be appropriately 
noted. 

[01 35] The standard eigenvalue problem for spatial fourth-order cumulant matrix 1 is 
defined as 

10 C^(r„r2,r3)e-Ae. (132) 

A scalar X is said to be an eigenvalue of spatial fourth-order cumulant matrix 1 if the equality in 
equation (132) holds a non-null eigenvector e , an associated eigenvector. Rewriting equation 
(132), it is found that an eigenvector of spatial fourth-order cumulant matrix 1 lies in the "right" 
null space of a matrix-pencil. That is 

15 (C:(r„r2,r3)-Al^)e = 0 (133) 

therefore 

eeiV^(C^r„r„r3)-;LI^). (134) 

The matrix-pencil 

{C:(rpr„r3),l}^c:(r„r„r3)-Al^ (135) 

20 is non-singular with rank N even though (r, , , ) has rank M when X is not an 

eigenvalue. Thus, the eigenvalue X will reduce the rank of the matrix-pencil 

(r^ , r2 , r3 ) , I by a value 7^'''" , which is referred to as the "geometric multiplicity" of the 

eigenvalue X and is given by 

77^-'" =N-p(c\{T,,T,,T,yXl^). (136) 

25 [01 36] Since A is an eigenvalue if and only if the rank of the matrix-pencil is reduced, 
the eigenvalues can be found by searching for roots of the characteristic equation. That is, the 
values that cause the determinant of the matrix-pencil to be zero, 

det(c:(r„r„r3)-AI^) = 0 (137) 

are eigenvalues. 
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10 



(138) 



[01 37] The determinant in equation (137) is defined as the sum of products 

<te(c:(.,..,,r,)-^i„)=2:(-i)'"''"'-'"'([c;(^..^=.'.)]„-*.,4- 

([c:(^,>^..^3)L.-<s*,^) 

where the set {c,, , . . . , } is the permutation of the first positive integers, with the 
sximmation occurring over all Z = iV! such permutations, and the scalar represents the 
element in the row and c'* column of the identity matrix . The exponent in (138) is a 
scalar defined as a fimction of the set {c,, , . . . , } by 



(139) 



n-l 



where ^ is the number of integers in the sequence , . . . , Cjy that are less than c„ . Substituting 
equation (84) in to (138) 



f M 



det(c:(r,.r,.r3)-AI^) = 2:(-l)' 



(140) 



it becomes clear that each non-zero value of X that will cause the determinant in (140) to be 
equal to zero will be a linear combination of the individual source signal fourth-order cumulants. 
Therefore, since each eigenvalue is a linear combination of the source signals foiulh-order 
cumulants it is reasonable to expect that the eigenvectors will be linear combinations of the 
1 5 associated steering vectors. This in fact can be shown to be true. Substituting equation (87) for 
the spatial fourth-order cumulant matrix, equation (132) becomes 

i;<(r„r„r3)v,v»e = Ae. (141) 



>1 



The vector inner product v" e will equal a scalar that is defined here as 



20 then equation (141) becomes 



s- = ve 



M 



(142) 



(143) 
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[01 38] Alternatively, it can be show that each eigenvalue is a linear combination of the 
source signal fourth-order cumulants by pre-multiplying (141) by the Hermitian transpose of the 
eigenvector and dividing by the inner product, e"e , since there is only one eigenvalue such that 

the equality in equation (141) for a particular eigenvector (See, for example, D. A. Harville, 
5 Matrix Algebra from a Statistician 's Perspective. (Springer-Verlag, New York, NY: 1 999), 
which is hereby incorporated by reference in its entirety as if presented herein), each eigenvalue 
can therefore be expressed as 

^ = Z<(^P^2,73)-^. (144) 

which is clearly a linear combination of the individual source signals' fourth-order cumulants. 

10 [01 39] If it is assumed that the mixing matrix V has fiiU column rank, spatial fourth- 
order cumulant matrix 1 will have rank M by property 4. Therefore, there will be M non-zero 
eigenvalues whose sum will equal the trace of the spatial fourth-order cxmiulant matrix. That is, 
employing property 2 of spatial fourth-order cumulant matrix 1 

|;;i,=/r[c:(r„r,.T3)] = |;c;(r„r„r3). (145) 

15 Substituting (144) into equation (145) results in 

^,e"v,v"e ^ 



E< (^..^=.^.)I-4fc^ = Z<(^i.^=.-.)- (146) 



[0140] Clearly, there exists an indeterminacy in the standard eigen analysis of spatial 
fourth-order cumulant matrix 1 . The same indeterminacy exists for definitions two and three 
and arises from the fact that in general, the identity matrix is not "similar" to spatial fourth-order 

20 cumulant matrix 1. Therefore, a new matrix must be foimd, which for now can be referred to as 
the new B matrix, that is "similar" to the spatial fourth-order cumulant matrix to replace the 
identity matrix in the matrix-pencil and thus move to a generalized eigen analysis of spatial 
fourth-order cumulant matrix 1 with respect to this new B matrix. Here "similar" means that the 
B matrix can be factored into a bilinear form, as was done for spatial fourth-order cumulant 

25 matrix 1 , with the mixing matrix, and the modified mixing matrix for definitions 2 and 3, being 
two of the three factors and some diagonal matrix being the third. That is 

B = VDV« (147) 

where D is a diagonal matrix. 
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[0141] Definition, Properties, and Spectral Theory of Matrix-Pencils 

A matrix-pencil is a special case of what is known in mathematics as a polynomial operator 
pencil Polynomial operator pencils and their associated spectral problems arise naturally in 
many diverse areas such as differential equations, boundary value problems, control theory, 
5 harmonic systems analysis, wave propagation, elasticity theory, circuit simulation and modeling, 
and hydromechanics. See, for example, A. S. Markus, Introduction to the Spectral Theory of 
Polynomial Operator Pencils, Translation of Mathematical Monographs, Vol 7L (American 
Mathematical Society, Providence, RI: 1988), which is hereby incorporated by reference in its 
entirety as if presented herein. In general, an order polynomial operator pencil takes the form 

10 A ( A) = Ao + AAj + " • + A" A„ (148) 

where /I is a spectral parameter and the A^. 's are linear operators acting in a Hilbert space. A 
matrix-pencil, P [X) , is a first-order polynomial operator pencil that has the form 

P(A) = A-AB. (149) 

[01 42] In general, matrix-pencils are classified as being either regular or singular. See, 
15 for example, A. S. Markus, Introduction to the Spectral Theory of Polynomial Operator Pencils, 
Translation of Mathematical Monographs, Vol 7L (American Mathematical Society, 
Providence, RI: 1988), Z. Bai, J. Demmel, J. Dongarra, A. Ruhe, and H. van der Vorst, 
Templates for the Solution of Algebraic Eigenvalue Problems: A Practical Guide, (SIAM, 
Philadelphia, PA: 2000), K. Kanatani, Statistical Optimization for Geometric Computation: 
20 Theory and Practice. (Elsevier Science B.V., Amsterdam, The Netheriands: 1996), G. H. Golub 
and C. F. Van Loan, Matrix Computations. (The Johns Hopkins University Press, BaUimore, 
MD: 1996), F. R. Gantmacher, The Theory of Matrices, Volume I (AMS Chelsea Publishing, 
Providence, RI, 1977), and F. R. Gantmacher, The Theory of Matrices, Volume II. (AMS 
Chelsea Publishing, Providence, RI, 1989), each of which is hereby incorporated by reference in 
25 its entirety as if presented herein. If the two matrices, A, B , are square and the determinant of 

the matrix-pencil is not identically zero for all values of X , that is 

det (P (/L)) = det ( A - AB) ^ 0 VA (150) 

then the pencil is regular otherwise it is singular. Regular pencils have well defined eigenvalues 

which change continuously as fimctions of matrices A and B . Singular pencils, on the other 

30 hand, have eigenvalues that are discontinuous functions of A and B . Both types of pencils arise 

in practice and, are applicable to the BSS technique in accordance with the present invention. 
Note that the standard eigen problem is a regular matrix-pencil with B = . 
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[0 1 43] Properties and Spectral Theory of Regular Matrix-Pencils 

Regular pencils can be further classified as being Hermitian or non-Hermitian. Non-Hermitian 
matrix-pencils and their associated generalized non-Hermitian eigen problems arise when either 
A or B is non-Hermitian or B is not positive definite. Due to property 1 of the spatial fourth- 
5 order cumulant matrix, the spatial fourth-order cumulant matrix-pencil will in general be non- 
Hermitian. This will be shown to hold for all three definitions. Therefore, the focus will be on 
non-Hermitian regular pencils only and hence forth when the term regular pencil is used a non- 
Hermitian pencil is implied. Please see, for example, Z. Bai, J. Demmel, J. Dongarra, A. Ruhe, 
and H. van der Vorst, Templates for the Solution of Algebraic Eigenvalue Problems: A Practical 

10 Guide, (SIAM, Philadelphia, PA: 2000), K. Kanatani, Statistical Optimization for Geometric 
Computation: Theory and Practice, (Elsevier Science B.V., Amsterdam, The Netherlands: 
1996), G. H. Golub, and C. F. Van Loan, Matrix Computations, (The Johns Hopkins University 
Press, Baltimore, MD: 1996), and F. R. Gantmacher, The Theory of Matrices, Volume I, (AMS 
Chelsea Publishing, Providence, RI, 1977), each of which is hereby incorporated by reference in 

1 5 its entirety as if presented herein, for discussions on Hermitian pencils. 

[01 44] The characteristic polynomial of a regular NhyN matrix-pencil, 

p{A) ^ det(P(A)) = det(A- AB) (151) 

is by definition not identically zero for all values of Z . The degree of p{Z) is at most N . This 
means that there are N eigenvalues, which may be finite or infinite, with the roots of = 0 

20 being the finite eigenvalues of the matrix-pencil The set of eigenvalues of the matrix-pencil, 

P(/l) , are more commonly known as the "generalized" eigenvalues of the matrix A with respect 

to the matrix B and are defined by 

JL (A,B) = {z 6 C: det (A - zB) = 0} (152) 

[0145] The eigenvalues of a regular pencil are continuous fimctions of A and B thus 
25 small changes in A and B cause small changes in the eigenvalues. If the degree of the 
characteristic polynomial is less than N , then the pencil is said to have iV-M infinite 
eigenvalues, where M is the degree of the characteristic polynomial p{y^) • The set of all 

eigenvalues, /1(A,B) , of a matrix-pencil is referred to as its spectra. See for example , and F. R. 

Gantmacher, The Theory of Matrices, Volume IL (AMS Chelsea Publishing, Providence, RI, 
30 1989), which is hereby incorporated by reference in its entirety as if presented herein, and A. S. 
Markus, Introduction to the Spectral Theory of Polynomial Operator Pencils, Translation of 
Mathematical Monographs, Vol, 77. (American Mathematical Society, Providence, RI: 1988), Z. 
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Bai, J. Demmel, J. Dongarra, A. Ruhe, and H. van der Vorst, Templates for the Solution of 
Algebraic Eigenvalue Problems: A Practical Guide. (SIAM, Philadelphia, PA: 2000), K. 
Kanatani, Statistical Optimization for Geometric Computation: Theory and Practice. (Elsevier 
Science B.V„ Amsterdam, The Netherlands: 1996), G. H. Golub and C. F. Van Loan, Matrix 
5 Computations. (The Johns Hopkins University Press, Baltimore, MD: 1996), and F. R. 

Gantmacher, The Theory of Matrices, Volume L (AMS Chelsea Publishing, Providence, RI, 
1977)[45-50]. Note that as with the standard eigenvalues, an eigenvalue reduces the rank of the 
pencil by a value rj^^"" , which is referred to as the "geometric multiplicity" of the eigenvalue X . 

[01 46] For each finite eigenvalue, any non-zero vector lying in the right null space of the 
10 matrix pencil evaluated at the eigenvalue is defined as a "right" eigenvector for that eigenvalue. 

e€iV,(A->lB) (153) 
That is, for X e /1(A,B) , any vector e that satisfies 

(A-ylB)e = 0, e^tO (154) 

is an eigenvector corresponding to that eigenvalue. As with the eigenvalues of a matrix-pencil, 
15 the eigenvectors are often referred to as "generalized" eigenvectors. For an infinite eigenvalue, 
any non-zero vector lying in the right null space of the matrix B is an eigenvector. That is any 
non-zero vector that satisfies 

Be = 0 (155) 

corresponds to an eigenvalue /I = oo . An NbyN regular matrix-pencil may not have N linearly 
20 independent eigenvectors. However, at least one independent eigenvector will exist for each 
distinct eigenvalue. As with standard eigenvectors, the set of generalized eigenvalues /1(A,B) 

is unique while the set of eigenvectors is not. 

[0147] Each regular matrix-pencil has two associated subspaces, denoted X and Y , 
that have the same dimension and satisfy 

25 AxsY.BxeY \/xsX . (156) 

These subspaces are called right and left deflating subspaces, respectively. Further, 

span,^ {Ax,Bx} = y (157) 

and therefore 

AX ^BX =7 . (158) 
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Deflating subspaces are important in the development of techniques for solving regular 
generalized eigen problems (See, for example, P. Van Dooren, "Reducing Subspaces: 
Definitions, Properties, and Algorithms," Matrix Pencils, Proc. Pite Havsbad, Lecture Notes in 
Mathematics 973, Springer-Verlag, New York, NY, 1982, pp. 58-73, which is hereby 
5 incorporated by reference in its entirety as if presented herein)[51], such as the QZ algorithm, 
which is currently considered the most powerful technique for solving dense non-Hermitian 
regular generalized eigen problems. 

[01 48] Finally, let X and Y be non-singular matrices where 

A = Y"AX B = Y''BX. (159) 

1 0 Then the matrix-pencil 

P(A) = A-AB (160) 

is "equivalent" to the matrix-pencil P [X) and X and Y are referred to as "equivalence 
transformations". The matrix-pencil P(A) has the same eigenvalues as P(A) and its right 
eigenvectors, denoted e , are related to the right eigenvectors of the pencil P(/l) by the 
15 transformation 

e = X-'e. (161) 
[0 1 49] Properties and Spectral Theory of Singular Matrix-Pencils 
Matrix-pencils are singular if either they are rectangular or they are square and 

det (P (;i)) = det (A - AB) = 0 VA (1 62) 

20 holds. For a square pencil to be singular, both matrices A and B must be singular and have a 
common nuUspace. That is 

det(A) = det(B) = 0 

/ ( / . (163) 
N,(A) = N,(B) 

are necessary and sufficient conditions for the pencil P (A) to be singular. Both cases arise in 

practice and are significantly more difficult than regular pencils to handle. Since by definition 
25 the spatial fourth-order cumulant matrix is square, only square singular pencils are considered. 

[01 50] The characteristic polynomial of a singular NhyN matrix-pencil is equal to zero 
for all functions of A . Therefore, the eigenvalues of a singular pencil are discontinuous 
functions of the matrices A and B and care must be taken in defining the eigenvalues of singular 
pencils. Obviously, the eigenvalues can no longer be found by finding the roots of the 
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characteristic polynomial. Instead, the concept of reducing subspaces is used to define the 
eigenvalues and eigenvectors of a singular pencil. 

A pair of right and left reducing subspaces of the pencil P (A) , denoted X and Y 

respectively, satisfy 

5 Axer,Bx€y Vx€jr (164) 

and 

span,^ {Ax,Bx} = r . (165) 

where the dimension of the right reducing subspace, X , is greater than the dimension of the left 
reducing subspace Y by the dimension of the right null space of the pencil over the field of all 
10 rational fimctions of X . That is 

dim(^ ) = dim(y ) + dim(N,(A-AB)). (166) 

The reducing subspaces play a role similar to that of deflating subspaces for regular pencils. 
The rank of a matrix-pencil is in general a constant M for most values of k . 

p(p(A)) = M (167) 

15 [0151] However, for a certain set of values the rank of the pencil is "reduced", thus 

motivating the concept of a reducing subspace. The set of values, denoted /1(A,B), that contain 

the values of X that cause the rank of the singular pencil to "reduce" are the eigenvalues or 
spectra of the singular pencil. 

A(A,B) = {z e C: p(A - zB) < M\ (168) 

20 The amount the rank of the pencil is reduced is the geometric multiplicity, 77^^*"" , of the 
particular eigenvalue. 

rf^^ =M-/7(P(A)), A€;i(A,B). (169) 

Note that the eigenvalues of a singular matrix-pencil can be finite, infinite, or indeterminate. 

[01 52] For each finite eigenvalue, any non-zero vector lying in the right null space of the 
25 matrix pencil evaluated at the eigenvalue is defined as a "right" eigenvector corresponding to 
that eigenvalue. 

eeA^,(A-;iB) (170) 
That is, for A € /I (a, B) , any vector e that satisfies 
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(A-AB)e = 0, e^tO (171) 

is an eigenvector corresponding to that eigenvalue. For an indeterminate eigenvalue, any non- 
zero vector lying in the right null space of the matrix B , and thus in the right null space of 
matrix A , is an eigenvector corresponding to an indeterminate eigenvalue. Put in other words, 
5 any non-zero vector lying in the right nullspace of A (or B ) is an eigenvector corresponding to 
an indefinite eigenvalue. Rewriting equation (171) and solving for A results in 

, e"Ae 

Clearly, if e lies in the common right null space of A and B , A = 0/0 and thus the eigenvalue is 
indetemiinate. 

10 [01 53] As with regular pencils, the concept of "strict" equivalence is now defined. Let 
X and Y be non-singular matrices that do not depend on A where 

A = Y"AX B = Y"BX. (173) 

Then the matrix-pencil 

V(A) = A-AB (174) 

15 is "strictly equivalent" to the matrix-pencil P(/l) and X and Y are referred to as " strict 
equivalence transformations". The matrix-pencil P(yl) has the same eigenvalues as P(A). 
Also, the right and left reducing of the matrix-pencil P (A) , X and Y , are related to the right 
and left reducing subspaces of the pencil P(/l) by 

X^=X''X y=Y"y. (175) 

20 The consequence of the effect of the equivalence transformation on the reducing subspaces is 
that the right eigenvectors of P(^) j denoted e , are related to the right eigenvectors of the pencil 

P(^) by the transformation 

e = X-*e. (176) 

[0 1 54] Wide Sense Equivalence of Matrix-Pencils 

25 The term "strict" equivalence was emphasized previously herein to distinguish it from what is 
defined here as "wide sense" equivalence. Given the M by fiiU row rank matrices X and Y 
that are independent of A. , where 

AsY'^AX B = Y"BX (177) 
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then the N hy N singular pencil P (A) is said to be wide sense equivalent to the M by M non- 
singular pencil P(/l) where 

P(A) = A-AB. (178) 
Note that having rectangular X or Y is a sufficient condition to guarantee that P(>l) is singular. 

5 [01 55] It will now be determined if the wide sense equivalence transformations preserve 
the spectra of P(/l) and if the eigenvectors of P(/l) are related to the eigenvectors of the non- 
singular pencil P(A) by some equivalence transformation. To show this is true, let 
AeAIAjBl, >t(A,B)^>^^(A,Bi and e be a finite or infinite generalized eigenvalue and 
associated eigenvector of the singular pencil P(A). Since the M hy N matrix X has full row 
10 rank it has a "right" inverse. That is a iV by M matrix X"^'^ exists such that 

XX-'^=Im- (179) 

Also, since the matrix Y has full row rank, Y" has full column rank and therefore Y" has a 
"left" inverse. That is a M by matrix ( Y" ) exists such that 

(y«)""y"=I,. (180) 

15 Clearly 

(y")'"p(A)X-"-=(y»)""y»(A-AB)XX-'' = P(A). (181) 

The generalized eigenvalue problem is formulated as 

Ae = iBe. (182) 

Define the by 1 vector y as 

20 ys[(Y»)'"]"e (183) 

where e is an eigenvector of the matrix-pencil P(/l). The products y"Ae and y"Be are 
scalars, therefore 

_ y" Ae 
y«Be 

Similarly, an eigenvalue of the non-singular pencil P(>1) is 



e"Ae 

25 ^ = ^ir^- (185) 

e"Be 
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Substituting (177) in to equation (184) results in 



. y" Y"AX e 

A = ^-f- — (r. (186) 
y"(Y"BX)e 

Then, using equation (183), (186) becomes 

e"(Y")-"(V"AX)i e"AXI 
e"(Y")""(Y"BX)« e"BXe- 

Clearly every finite or infinite i e ;i^A,Bj is an eigenvalue of the pencil P(A) with a 
corresponding eigenvector 

e = X-'''e. (188) 

[01 56] It can therefore be concluded that the set of finite and infinite eigenvalues of 
P(A) , i^A,B j is equal to the set of eigenvalues of the non-singular pencil. That i 



tis 



10 i(A,B) = A(A,B) (189) 

and that the eigenvector e of P(A) is related to the eigenvector of P(A) by the equivalence 
transformation 

e = X-^^e. (190) 

[0 1 57] The Spatial Fourth-Order Cumulant Matrix-Pencil: Definition and Properties 

15 The spatial fourth-order cumulant matrix-pencil is defined on a pair on a pair of two spatial 
fourth-order cumulant matrices at delay lags (0,0,0) and (rpZ-jjTj) , as 

P,(A,f)^C:(0,0,0)-/lC:(rpr2,T3) (191) 

where the set of non-zero delay lags is denoted in vector form as t s [r, , 73 , ^3 ] . As with the 

spatial fourth-order cumulant matrix, there are in three definitions for the spatial fourth-order 
20 cumulant matrix-pencil; each corresponding to the definition used for the pair spatial fourth- 
order cumulant matrices. Spatial fourth-order cumulant matrix-pencil 1 uses a pair of spatial 
fourth-order cumulant matrices 1 and is given in equation (191) above. Spatial fourth-order 
cumulant matrix-pencil 2 is defined on a pair of spatial fourth-order cumulant matrices using 
definition 2 as 

25 p;(A,f) = cf(0,0,0)-;iC:'(r„r2,r3). (192) 
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Finally, spatial fourth-order cumulant matrix-pencil 3 is defined on a pair of spatial fourth-order 
cumulant matrices using definition 3 as 

P;(>l,f) = cf(0,0,0)-^cf(r,.r„r3). (193) 

Since it was shown in Chapter 4 that all three definitions have similar matrix properties if the 
5 Hadamard product preserves rank, the properties for spatial fourth-order cumulant matrix-pencil 
1 are derived and any differences for spatial fourth-order cumulant matrix-pencils 2 and 3 noted. 

[0 1 58] Spatial Fourth-Order Cumulant Matrix-Pencil Property 1 

Spatial fourth-order cumulant matrix-pencil 1 can be factored into Hermitian form as 

P,(^f) = VF,(;L,f)V« (194) 

10 where V is the mixing matrix and is an M byM matrix-pencil on a pair of diagonal 

signal cumulant matrices. 

P, ( A, f ) = c; (0, 0, 0) - ZCt (r, , r„ r3 ) . (195) 

[01 59] Spatial fourth-order cumulant matrix-pencils 2 and 3 can be factored in to the 
bilinear form 

15 P^(>l,f) = VP,(^f)V" (196) 

and 

p;(^f)=rp,(A,f)v^ (197) 

respectively. 

[0 1 60] Spatial Fourth-Order Cumulant Matrix-Pencil Property 2 

20 The rank of spatial fourth-order cumulant matrix-pencil 1 equals the number of signals, M , for 
"most" values of A if V has full column rank. That is, iox XiX {q\ (O, 0, 0) , (tj ,t^,t^ )) and 

p(V) = M, 

p(P,(A,f)) = M. (198) 

Spatial foxuth-order cumulant matrix-pencils 2 and 3 possess the same property if the Hadamard 
25 product (196) preserves rank. 

[0161] Spatial Fourth-Order Cumulant Matrix-Pencil Property 3 

The spatial fourth-order cumulant matrix-pencil is in general non-Hermitian. It is a regular 
pencil if M = N and V has full column rank, otherwise, when M <N or if V does not have 



WSH\98573.1 



56 



GCSD-1430 



HAR62 020 



full column rank it is a singular pencil. Spatial fourth-order cumulant matrix-pencils 2 and 3 
additionally require that the Hadamard product given in (4.65) preserve the rank of V for the 
pencil to be regular. 

5 [0162] Spatial Fourth-Order Cumulant Matrix-Pencil Property 4 

The spatial fourth-order cumulant matrix-pencil, P^ i^^^) ? is strictly equivalent to the regular 
pencil P^ (A, f ) if P^ (A, f ) is a regular pencil. Otherwise, the spatial fourth-order cumulant 
matrix-pencil, P^ (^.*) , is wide sense equivalent to the regular pencil P^ (>1,t) if the mixing 
matrix has full column rank. Spatial fourth-order cumulant matrix-pencils P^^ (/l,f ) and 
10 P, ( A, f ) additionally require that the Hadamard product given in equation (4.65) preserve rank. 

[0163] Spectral Analysis of the Spatial Fourth-Order Cumulant Matrix-Pencil 

The spectral theory of the spatial fourth-order cumulant matrix-pencil is explored in two 
manners. First exploiting the equivalence, strict or wide sense, it will be show that the finite 
spectra of the pencil P^ (^j^) has a one-to-one mapping to set of signal fourth-order cumulants 

15 and thus each generalized eigenvalue can be associated with a source and its associated 

eigenvector with the signal's steering vector. The same relation is then shown by using the outer 
product expansion of the eigenvalue problem and the linear independence of the steering vectors. 
In both cases V is assumed to have full column rank and it is the finite generalized eigenvalues 
and their associated eigenvectors that are the focus since it is only the signal subspace that is of 

20 interest. As before, spectral theory for spatial fourth-order cumulant matrix-pencil 1 will be 
presented and any differences that may arise for spatial fourth-order cumulant matrix-pencils 2 
and 3 will be noted. 

[01 64] From property 4 of the spatial fourth-order cumulant matrix-pencil, P, (A, f ) is 
equivalent, in a strict or wide sense, to the M by M regular pencil P^ By the definition 

25 of equivalence, the set of finite and infinite spectra eigenvalues of P, (/1,t) , 
X(cl (0, 0, 0) , C^ (r, , , 7-3 )) , is equal to the spectra of the pencil P^ ('^', t) , 

i(c:(0,0,0),C:(r,,r,,r3)) = A(c;(0,0,0),C:(r,,r,,r3)) (199) 
Clearly if (A, f ) is regular then 
30 i(c:(0.0.0),C::(r,.r2.r3)) = A(c:(0,0.0),C:(T„r,.T3)). (200) 
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[01 65] Since the pencil (A, f ) is regular, its spectra can be determined by finding the 
roots of its determinate set equal to zero. Since (/1,t) is diagonal by definition, the 
determinate will be the product of its diagonal components, i.e. 



det(P,(A,f)) = n(c;(0,0,0)-Ac;(r,.r„r3)) (201) 

5 By inspection of (201), the spectra of P^ (A, f ) is the set 

X \ (0,0,0) 1 
A C;(0,0,0),C:(rpr„r3) W \zeC:z^^ ^,7e{l,...,M} . (202) 

By Assumption A2 the signal cumulants are strictly non-zero and as such the spectra will contain 
M finite, non-zero eigenvalues, counting multiplicities, each corresponding to the ratio of a 
particular signal's cumulants at a zero and non-zero set of lags. Since the eigenvalues maybe 
1 0 complex, there is no fixed way to order them. For convenience, however, they will be ordered 
by their association with the signal as Xj , i.e. 

(0,0,0) 

(203) 

Of the M eigenvalues, there may only be^ distinct values they assume, denoted as //^ , with 
each value having a multiplicity of tj^^ . Therefore, the eigenvalues can be grouped into K sets, 
1 5 denoted (C^ (0, 0, 0) , (r,, » ^3 )) » that contain the eigenvalues equal to /j^ . 

;i,(c;(0,0,0),C;(r„r„r3))A l{A,€C:A,=//,} (204) 

Note that for a diagonal regular pencil, /yf = rj^^ = rj^ . Clearly, 

>l(c;(0,0,0),C:(rpr,,r3)) = A(c:(0,0,0),C:(r,,r,,r3))u... ^^^^^ 

u^4c:(0,0,0),C:(r„r„r3)) 

For each jUj^ there are rjf^ signals with the identical ratio of their cimiulant at zero lags to their 

20 cumulant at non-zero lags. This ratio is the inverse of what will be defined in the subsequent 
chapter as the normalized fourth-order auto-cumulant. 

[01 66] A "right" eigenvector corresponding to a particular eigenvalue for a regular pencil 
will be a non-zero vector that lies in the right null space of the pencil evaluated at the eigenvalue. 

P,(>l = A.,f)e^=0 (206) 
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The eigenvector is a M by 1 vector with M-rj^ zeros in the positions with indices 

corresponding to the columns of the diagonal pencil containing non-zero elements when 
evaluated sX Z = A,j=ju^,a distinct eigenvalue. This is now illustrated with an example. 

[01 67] For example, the M by M diagonal pencil, M > 3 , has the form 
P,(A,t) = 

c*{0,0,0)-Jic*{T„T„T,) 0 ... ... 0 



1 
0 



If 



c;(0.0,0)-.lc;(r„r„r3) i 

0 

0 <(0,0.0)-Ac;(r„r„r3) 



< (0,0,0) ^ < (0,0,0) 



then 



< (0,0,0) < (0,0,0) _ 

10 and the distinct eigenvalue //, has a multiplicity of two. The eigenvectors corresponding to the 
eigenvalues and have the form 

ej=[e,j 0 e,j 0 - O]' ye{l,3} 

where e^j and are arbitrary scalars, both not equal to zero. Clearly the eigenvectors are not 

unique, however the locations of the non-zero elements are and the eigenvectors are uniquely 
1 S associated with the signals. 

[01 68] A set of M eigenvectors is required. However, when there are only K distinct 
eigenvalues, care must be taken in selecting the eigenvectors corresponding to a repeated proper 
value so that subsequent separation stages may be used to separate the signals associated with a 
repeated eigenvalue. The constraints for finding eigenvectors corresponding to repeated 
20 eigenvalues will be discussed in the following chapter. 

[01 69] Consider now the spatial fourth-order cumulant matrix-pencil, (A, f ) . If the 

mixing matrix V is assumed to have full column rank, then by spatial fourth-order cumulant 
matrix-pencil property 4, (A, f ) is equivalent, either strictly or in a wide sense, to the pencil 
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(A, f ) . Thus, the pencil (/I, t) has the same finite and infinite eigenvalues as P^ (A, f ) and 
the eigenvectors of (>1,t) , designated e^. , corresponding to the finite eigenvalues are related 
to the eigenvectors of P, [A, f ) by 

e,=(v»)"''e,. (207) 

5 Since the rows of V" are the conjugated signal steering vectors by definition, for 

V«(v«p=I, (208) 

the columns of ( V" ) must be orthogonal to all steering vectors except the one in the row with 
the index corresponding to its own column index. Therefore, the columns of ( V" ) ^'^ are 
uniquely associated with a signal's steering vector. Thus it can be seen that 

10 eJV = {v»e,}" ={V»(V")^'%,}" =ej. (209) 

[01 70] Thus the eigenvectors, e^. , can be used to blindly separate the signals. As 

mentioned earlier, the selection of the eigenvectors corresponding to a repeated eigenvalue must 
be done with care. Clearly the output of e"V will be a linear combination of the rows of the 

mixing matrix and thus will result in a vector who is linear combination of the rows of the 

15 steering vectors of the signals associated with the eigenvector, that is the rows of V 

corresponding to the non-zero elements of e^. . For spatial fourth-order cumulant matrix-pencils 

2 and 3, if the Hadamard product preserves the rank of V , then a similar result is found by 
exploiting a corresponding equivalence transformation between the "left" eigenvectors of the 
pencils P^ (A, t) and P, (A, t) . Note that similar results will be achieved with the left 

20 eigenvectors, i.e. those Ihy N vectors, dj , that lie in the left null space of the pencil evaluated 

at the eigenvalue. 

[01 71] The preceding spectral analysis of the spatial fourth-order cumulant matrix-pencil 
can be performed in an alternative way by expanding the pencil into a sum of outer products and 
exploiting the linear independence of the steering vectors. The generalized (right) eigenvalue 
25 problem for the matrix-pencil P^^ (A, t) is defined as 

C:(0,0,0)e,=//,c:(r„r2,r3)e,. (210) 

Substituting equation (87) for the spatial fourth-order cumulant matrix in (210) and rearranging 
terms results in 
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|;v,[c,^(0,0,0)-//,c;(r,.r„T3)]v;e,=0. (211) 



If the mixing matrix is assumed to have full column rank its columns are linearly independent 
and thus 

[c;(0.0,0)-;/,c;(r.,r,.r3)]v;e,=0 (212) 
5 for all j for the equality in equation 211 to hold. This leads to the 

<(Q>Q>Q) ,,,,, 

Mk^-n X (213) 

for any j when ^0, Since by property 5 V" and C^ij^.r^.r^) have a common right null 

space, any eigenvector that lies in the right null space of V" has a corresponding indeterminate 
eigenvalue, since e^^ can only lie in the null space of V" if the pencil is singular. Therefore, as 

10 with the equivalence approach presented previously, the eigenvalues and their associated 
eigenvectors are uniquely associated with the source signals with the ratio 

<.(o>o.o) 



(214) 



acting as a discriminant. Similar results hold for spatial fourth-order cumulant matrix-pencils 
two and three if the modified mixing matrix V has full column rank. 

15 [01 72] A blind source separation technique in accordance with the present invention is 
described utilizing all three spatial fourth-order cumulant matrix definitions and the conditions of 
identifiability are discussed. A normalization method is also developed to allow the separation 
algorithm to maximize the separation power efficiency (SPE). The concept of a normalized 
fourth-order auto-cumulant is presented and a method of selecting eigenvectors for repeated 

20 eigenvalues to facilitate cascaded processing is developed. 

[01 73] Figure 5 is a functional block diagram of a blind source technique and processor 
in accordance with an embodiment of the present invention. Blindly separating M statistically 
independent source signals xmder the narrowband assimiption requires finding a N by M 
separation matrix W that will diagonalize the mixing matrix V . That is, fi-om equation (39), a 
25 separation matrix is sought such that 
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w"v = 



A 0 0 

0 A ; 

: 0 

0 0 



(215) 



Calculating this separation matrix is one function of the bUnd source separation technique. 

[01 74] It was previously explained that the generalized eigenvectors of the spatial fourth- 
order cumulant matrix-pencil would separate signals based on the ratio of their cumulants at two 
5 different sets of time lags. These results are exploited in the formalization of a technique to 
calculate a separation. This technique will theoretically minimize the residual interference-to- 
signal ratio (ISR) and, with the proper normalization, to maximize the separation power 
efficiency (SPE). 

[01 75] As also previously described, a factor in finding the eigenvectors of the spatial 
10 fourth-order cumulant matrix-pencil is what was referred to as the normalized fourth-order auto- 
cumulant. This arises fi-om the finite eigenvalues of the spatial fourth-order cumulant matrix- 
pencil equaling the inverses of the individual source signals normalized fourth-order auto- 
cumulants; the aforementioned ratio of cumulants at two different sets of time lags with the set of 
time lags in the numerator cumulant equal to zero. Specifically, since it was shown that if a 
15 signal has a unique normalized fourth-order auto-cumulant, the associated eigenvector is 
orthogonal to all of the other signals' steering vectors, the normalized fourth-order auto- 
cumulant can be thought of as acting as a signal discriminator function. In this chapter the 
normalized fourth-order auto-cumulant will be defined and some conmients on its use as a 
discriminator function will be made. 

20 [01 76] When multiple signals have the same normalized fourth-order auto-cumulant at 
the set of delay lags used, repeated eigenvalues occur. In order to facilitate repeating the 
separation technique at a new set of time lags where ideally the signals will no longer have equal 
normalized fourth-order auto-cimiulants, care must be taken in selecting the eigenvectors of a 
repeated eigenvalue in order to guarantee the resultant steering vectors remain linearly 

25 independent. Criteria are presented below for selecting eigenvectors associated with a repeated 
eigenvalue. It will be shown that the resultant set of new steering vectors remains linearly 
independent. 

[01 77] One measure of performance used in assessing the blind source separation 
algorithm is separation power efficiency (SPE). To achieve an SPE of 1, the inner product of the 
30 separation vector and the associated steering vector must have a magnitude of 1 . To achieve this, 
the eigenvector, which forms the basis of the separation vector, must be normalized since, 
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although it is co-Hnear with the steering vector, it does not necessarily have the correct 
magnitude to guarantee that an SPE of 1 can be achieved. Therefore, a normalization algorithm 
is developed to guarantee that the SPE is maximized. Since there are three definitions for the 
spatial fourth-order cumulant matrix, different normalization techniques will be required for 
5 each. 

[01 78] Conditions of identifiability are presented below that will allow an instantaneous 
linear mixture of signals to be separated. These include the linear independence of the steering 
vectors, the statistical independence and non-Gaussian nature of the source signals, and existence 
of a set of time lags where every signal has a distinct normalized fourth-order auto-cmnulant, just 
10 to name a few. 

[01 79] Finally, the spatial fourth-order cumulant matrix-pencil based algorithm is 
presented step by step in a flow diagram. Each step is discussed and critical issues, if any, are 
presented. Difference that may exist in using the different spatial fourth-order cumulant matrix 
definitions in the algorithm will be highlighted. 

15 

[0 1 80] Normalized Fourth-Order Auto-Cumulant as a Signal Discriminator 

It was previously shown that the generalized eigenvalues of the spatial fourth-order 
cumulant matrix-pencil are 

ct (0,0,0) 

^j=TT jel,2,...,M. (216) 

20 For separation to occur, a distinct eigenvalue, Xj , is required for each signal. Therefore, Zj acts 

as a "signal discriminant". To investigate this discriminant and its properties, the normalized 
fourth-order auto-cumulant of the signal is defined as 



—4/ \ (^l>^2>^3) ^^i^x 



Clearly the generalized eigenvalue associated with the signal is the inverse of its normalized 
25 fourth-order auto-cumulant. 

^—rrr^ r (218) 

[0181] By assumption Al, the signal rj [t) is a stationary, non-Gaussian random process. 
Further, by assumption A2, the signal is assumed to have a zero mean with power Pj, and a non- 
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zero fourth-order moment. These assumptions ensure the signals fourth-order cxraiulant exists 

and is non-zero. A necessary extension to these assumptions is that the set of time lags, 

(r, , , ) , is chosen so that the fourth-order auto-cumulant also exists and is non-zero. Thus it 

may be assumed that the normalized fourth-order auto-cumulant exists and is finite. 

5 [01 82] Since the signal is assumed to be a stationary random process, its moments are 
dependent only on the time differences or lags (r, .t^^t^). Therefore, the normalized fourth- 
order cumulant is a three dimensional function. Thus, for separating signals there are three 
independent variables to work with to ensure the signals have unique normalized fourth-order 
auto-cimiulants as compared to a second-order technique that has only one independent variable. 
10 This is yet another distinct advantage of the fourth-order cumulant approach over the second- 
order spatial correlation based approach. 

[01 83] The normaUzed fourth-order auto-cumulant will, in general, be complex valued. 
Although the signal's cumulant at the set of time lags (0,0,0) will have a real value, the 

cumulant at time lags (r,, 72,^3) will be complex valued. Thus, the normalized fourth-order 

1 5 auto-cumulant will contain phase information that is a function of (r, ,^2,73). Source signal 

emitter attributes such as phase noise, carrier frequency, transmit filter response, amplifier 
response, transmitter clock jitter, propagation channel traasfer function, etc., will contribute to 
the source signal's normalized fourth-order auto-cxmiulant. From the definition of received 
source signal, 

20 0(0 = >/^'"yW (219) 

it is clear, employing cumulant property 1, that the normalized fourth-order auto-cimiulant is not 
a function of the signal's power. 



(0.0,0) 

Cum [rj (t)r; (t - r. {t-r.yj (t - 1, )] 

Cum[r.{t)r:{t)r,{t)r;{t)\ 

^ P]Cum[mj{t)m]{t-T,)m.{t-T,)mj{t-T,)\ 
PjCum[m,{t)m]{t)mj(t)m]{t)] 

^ Cum [nij {t) m] {t-T^)mj{t-r^) m] {t - )] 
Cum[mj{t)m](t)mj(t)m](t)\ 



(220) 
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Thus the signals are discriminated by having an underlying waveform that has a unique 
normalized fourth-order auto-cimiulant, not by having different signal powers. 

[01 84] As stated above, the unit power modulated signal from the emitter is affected 
by transmitter unique properties. Since in practice two transmitters hardly ever produce identical 
5 signals, a soiu'ce signal will most likely have a unique fourth-order auto-cumulant fimction and 
therefore have a unique normalized fourth-order auto-cumulant function. Therefore, it is 
expected that a set of time lags will exist where a group of signals will have unique normalized 
fourth-order auto-cumulants and can therefore be separated. 

[0185] Selecting Eigenvectors for Repeated Eigenvalues 

10 [01 86] When multiple signals' normalized fourth-order auto-cumulant functions happen 
to have the same value at the set of time lags chosen, the problem of repeated eigenvalues arises. 
In this situation care must be taken in selecting the associated eigenvectors to ensure that the set 
of separation vectors formed from these eigenvectors will transform the mixing matrix into a 
new reduced dimension mixing matrix with full column rank. This guarantees that the 

1 5 separation algorithm can be repeated to separate the signals associated with the repeated 
eigenvalue that are mixed by this new reduced dimension mixing matrix. 

[01 87] Figure 6 depicts repeating the separation algorithm for a single repeated 
eigenvalue, hi Figure 6, the M by 1 vector output of the first separation stage, y (r) , is 

partitioned into two vectors, one with the M -7]^ elements of y (/) that correspond to unique 
20 eigenvalues, denoted as y^ {t) , and the other, denoted (t) , with the rj^ elements of y (^) 
that correspond to the repeated eigenvalue, , which has multiplicity 77^ . As in the first 
separation stage, a new rjj^ by rj^ separation W^^^ is sought that will separate the signals 
associated with the repeated eigenvalue. The new separation matrix is found by repeating the 
spatial fourth-order matrix-pencil algorithm at a different set of time lags. However, to use the 
25 algorithm a second time, the conditions for identifiability discussed in a following section must 
hold. One of these is that the mixing matrix has full column rank and therefore the new reduced 
dimension, 7^ by rj^^ mixing matrix V^^j^ must have full column rank. Each repeated 

eigenvalue would have a similar new mixing matrix and would have the separation algorithm 
repeated. 

30 [01 88] The requirements for selecting the eigenvectors associated with a repeated 
eigenvalue so as to guarantee the new mixing matrix, V^j^ , will have full column rank are 

derived below. The set of integers that represent the signals associated with a particular 
eigenvalue is defined as 
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g,^{je{l2,...M}:^j=Ju,}, (221) 

Recalling that the eigenvalue Aj is equal to the inverse of the signals normalized auto- 
cumulant. 

Cr (0,0,0) 

^j- y \ (222) 

5 Since there are M signals there will be M eigenvalues, including repetitions, of which only K 
are distinct. The distinct eigenvalues are denoted as //^^ , kel,2,...,K , The scaled or 

normalized M associated by 1 eigenvectors are the columns of the separation matrix W. 

Wy=rA (223) 

From equation (215) it can be seen that if the separation matrix separates all the signals, the 
10 resultant matrix product W"V is diagonal This occurs only if there are M distinct 

eigenvalues. As previously described, for a repeated eigenvalue, the eigenvectors separated the 
signals associated with a particular eigenvalue from those not associated with it; however, the 
resultant scalar was a linear combination of the associated signals. Therefore, the matrix product 
W" V will have 77^ rows, indexed by the set , each with tj,^ non-zero elements in the columns 
1 5 indexed by the set for A: = 1, 2, . This holds for the M distinct eigenvalues case as well 
in which case K = M and //^ = 1 , VA: , A: = 7 , and each g^^ has only one element in it, k = j\ 
and thus W"V is diagonal. 

[01 89] The new mixing matrix Vj^^^ consists of the rj^ columns of V indexed by the 
set with the rows indexed by the integers not in the set removed, i.e. the rows with all 
20 zeros. Thus V^j^ *s a 7^ by rji^ matrix that linearly mixes the 77^ signals associated with the 
repeated eigenvalue to form the 77^ elements of the vector (t) . Since V^j^ is to the second 

stage separation process as V is to the initial separation process, it must have the same properties 
as V , primarily it must have full column rank. 

P(V,,) = /7, (224) 

25 The condition for selecting , y € g^ that ensures V^^^ has full column rank must now be 

determined. 

[0190] Since w^. is a scaled version of the eigenvector , a constraint on is in fact a 
constraint on the selection of Cy . It will now be shown that requiring the eigenvectors , for 
j e gf^ to be linearly independent is sufficient to guarantee that V^j^ will have full column rank if 
30 V has full column rank. 
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[0191] Separation Vector Formation: Normalizing the Eigenvectors 

[01 92] Although the eigenvectors are orthogonal to all signals except those with 
normalized auto-cumulants equal to the associated eigenvalue, the inner product 

eJyj=Sj (225) 

5 does not guarantee that the maximum SPE of 1 will be achieved. Therefore, the separation 
vectors are formed by scaling each eigenvector with a real normalization factor /j that 

guarantees a maximum SPE of 1. 

yvj=r;ej (226) 

For repeated eigenvalues, the normalization factor will have a different effect and there is no 
10 clear advantage to normaUzing the eigenvectors associated with repeated eigenvalues in the first 
separation stage. Further study of the effect of repeating the separation algorithm on the 
achievable SPE is needed. 

[0193] From equation (39) it can be seen that the inner product 

wjv.=p. (227) 

1 5 resxilts in a "loss" term Pj that in general is complex. From equation (63) it can be seen that the 
SPE is 

#,=wyv,v«w,. (228) 

Inserting equation (227) in to (228) results in 

= PjPj =\Pjf • (229) 

20 For the SPE to be 1 requires 

\pj\ = l (230) 
and thus a normalization factor /j is needed such that 

K"^| = kA"v;| = /;K| = l (231) 

and therefore 

25 rj=T^r (232) 

hi 

[0194] Calculation of this scale factor for the eigenvectors associated with unique 
eigenvalues is dependent on the particular spatial fourth-order cumulant matrix definition used 
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10 



15 



20 



since the available variables are different. For spatial fourth-order cumulant matrix 1 a 
normalization factor that will guarantee the SPE will achieve a maximum of 1 can be found and 
will be derived in the following sub-section. However, it will be shown for spatial fourth-order 
cumulant matrices 2 and 3 that the existence of the modified mixing matrix V in their bilinear 
forms causes the set of equations available for solving for the normaUzation factor to be under 
specified and thus using definitions 2 and 3 cause a power loss preventing the separation firom 
achieving an SPE of 1 . 

[0195] Nomialization for Spatial Fourth-Order Cumulant Matrix 1 

[01 96] The only data available to work with in normaUzing the eigenvectors are the 
spatial fourth-order cumulant matrices, the eigenvalues, and associated eigenvectors. From 
equation (225), 

Sj=e^yj (233) 
and as previously described, it is known, assuming Cy is associated with a distinct eigenvalue, 
that 

nT 



(235) 



V"e^.=[0 ... 0 e'j 0 ... o] (234) 

with the non-zero element in the y '* position. Therefore, since spatial fourth-order cumulant 
matrix 1 can be factored into Hermitian form as 

(0.0,0) =vc; (0,0. 0)V» 

where (0,0,0) is an M by M diagonal matrix, the product 
c:(0,0,0)e^. = VC:!(0,0,0)V«e^. 

= VC^(0,0,0)|[0 ... 0 ej 0 . 

= v|[0 ... 0 ffjcj (0,0,0) 0 .. 

The Euchdian or norm of (236) is then 

||c:(0,0,0)e,[= ^K(0,0,0)v, 

=|f^m(o,o,o)|| 

However, since 



or 



(236) 



(237) 
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10 



15 



20 



=1 



(238) 



then 



||c:(0,0,0)e,[=|^,||c^. (0,0,0)1 . (239) 

Further, pre-multiplying the product in equation (236) by the Hermitian transpose of the 
eigenvector results in the scalar 

e;c:(0.0,0)e,.=^;c;(0,0,0)e;v. 

= £jSjc:^{W) (240) 

= |f,fc; (0,0.0). 

Taking the ratio of the absolute value of (240) to (239) produces the scalar 



|e^"c: (0,0,0)e,| Jg,f|c; (0,0,0)1 _ 



|C^(0,0,0)eJ 



(0.0,0)1 



= 1^,. 



(241) 



Thus the unknown denominator in (232) has been solved for and therefore ttie normalization 
factor, when using spatial fourth-order cumulant matrix 1, is 

||c:(0,0,0)eJ| 



1 



(242) 



|e«c:(0.0,0)e,|- 

Normalization for Spatial Fourth-Order Cumulant Matrices 2 and 3 
Spatial fourth-order cumulant matrix 2 and 3 are not factorable into Hermitian 



[0197] 
[0198] 

form but instead factor into a bi-linear form as shown previously as 

C:'(r..r„r3) = VC:(r,.r„r3)V" 

and 

cf(r,.r„r3) = V-C;(r„r,.r3)V^ 



(243) 



(244) 



respectively. From the results in chapter 5 it is clear that pencils formed using spatial fourth- 
order cumulant matrices 2 and 3 will have the same eigenvalues with the associated eigenvectors 
of spatial fourth-order cumulant matrix-pencil 3 equal to the conjugate of the eigenvectors of 
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spatial fourth-order cumulant matrix-pencil 2. Thus, since the normalization factor is real, if it 
exists it would be the same for both definitions. 

[0199] Since spatial fourth-order cumulant matrices 2 and 3 are not factorable into 
Hermitian form, the modified mixing matrix has to be dealt with in attempting to estimate the 
5 normalization factor given in equation (232). Unfortunately, in general 

ejvj^sj. (245) 

Further, even for distinct eigenvalues, the eigenvector, specifically the right eigenvector , is in 
general no longer orthogonal to all modified steering vectors except v^ and it is not guaranteed 

that the modified steering vectors have a Euclidian norm of 1, that is in general 

10 y^Yj^l. (246) 

Thus the properties that spatial fourth-order cumulant matrix 1 possessed that allowed for the 
estimation of ^ej\ are not shared by spatial fourth-order cumulant matrices 2 and 3. 

[0200] Solving for given only spatial fourth-order cumulant matrix 2 or 3, the 

generalized eigenvalues of the associated pencil, and their associated left, , and right, , 

15 eigenvectors is under specified. Since spatial fourth-order cumulant matrix 1 can be factored 
into Hermitian form, the left and right eigenvectors of spatial fourth-order cumulant matrix- 
pencil 1 are related by a Hermitian transformation, that is if e^. is a right eigenvector of spatial 

fourth-order cumulant matrix-pencil 1 then e" is a left eigenvector. Thus the product 
eyc^(0,0,0)e^ has only two unknowns, one being Similarly, ||c^O,0,0)e^.|[ has the same 
20 two unknowns since ||v^.||^ = 1 and therefore can be solved for. However, for spatial fourth- 



order cumulant matrix 2, and similarly for 3, 

||c:'(0,0,0)e,|=||f;c; (0,0.0) V, 

<(0'0.0)||v,|L 



(247) 



(248) 



and 

a,c:'(0,0,0)e,=f;cj(0,0,0)a.v, 
= e;Sjc:^ (0,0,0) 

25 where dj is the 1 by AT left eigenvector associated with the y** signal and 

Sj^djXj. (249) 
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[0201] Thus there are two equations and four unknowns. Attempting to establish four 
equations by using the spatial fourth-order cumulant matrix 2 at delay lags (t^.t^.t^) results in 

now having four equations and five unknowns. Thus, for spatial fourth-order cumulant matrix 2, 
and similarly for 3, solving for the normalization factor results in an under specified problem that 
5 cannot be solve. This is yet another advantage of definition 1, since a normalization factor that 
guarantees a maximum SPE of 1 can be solved for. 

[0202] Conditions for Identifiabilitv 

[0203] Identifiability deals with the ability of the blind source separation algorithm to 
uniquely associate a separation vector with an arriving source signal and thus separate it out of 

10 the linear mixture by suppressing the other signals. In order for the proposed blind source 
separation algorithm to perform the separation certain conditions must be met. Some have 
aheady been presented as signal and noise assumptions and are restated here as conditions that 
are imposed for the spatial fourth-order cumulant matrix-pencil based blind source separation 
algorithm to achieve the separation of the source signals. The fewer conditions for identifiability 

1 5 required the more powerful the algorithm will be in the sense of handUng a wider variety of 
source separation problems. Five conditions for identifiability, CIl through CIS, are given 
below, 

CIl : The mixing matrix, V , has fiill column rank. This requires the number of sources be less 
than or equal to the number of sensors, i.e. M <N , and that the signal steering vectors be 
20 linearly independent, 

CI2: The normalized fourth-order auto-cumulant, c^^ (r, , , ^3 ) , is different for each signal. 

The algorithm may be repeated at different sets of time lags (r, , , T3 ) in a second separation 

stage operating only on the signals in the first stage that had identical normalized fourth-order 
auto-cumulants. 

25 CIS: The M source signals illuminating the array are statistically independent non-Gaussian 
stationary random processes and are stationary to order four over the spatial fourth-order 
cumulant matrix estimation period. 

CI4: The noise processes are stationary Gaussian random processes. They need not be 
spatially or temporally white. Stationarity is required only over the estimation period of the 
30 spatial fourth-order cimiulant matrix. 

CIS: For spatial fourth-order cumulant matrix definitions 2 and 3, the Hadamard product 

V=V©V©V (2S0) 
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preserves the rank of the mixing matrix V , i.e. the modified mixing matrix has full column rank. 
This condition is not required when using spatial fourth-order cxmiulant matrix definition 1. 

[0204] Separation Matrix Formation Algorithm 

[0205] Figure 7 and Figure 8 are flow diagrams of a process for performing the blind 
5 source separation using the spatial fourth-order cumulant matrix-pencil in accordance with an 
embodiment of the present invention. The algorithm requires as inputs the set of time lags 
(^p^2»^3) where {t^,T2,t^)^ (0,0,0) . Delay lag values, xi, T2, X3, are provided at step 61 and 
senor data values, x(t), are provided at step 63. It is recommended, that either r, 56 or ^3 56 0 

in order to preserve phase information. This will reduce the occurrence of repeated eigenvalues 
10 and thus reduce the number of times the separation has to be repeated. 

[0206] At step 60, the estimation of the spatial fourth-order cumulant matrix at lags 
(0, 0, 0) and (r, ,T2ytj) is performed matrix element by matrix element. Since a cumulant 

cannot be estimated directly fi-om the data, all moments up to order four must be estimated. The 
estimation can be done either in a real time manner as the array samples the propagating 
15 wavefields and generates the sensor output data x(/) or after the entire data set required to 

estimate the cumulants has been captured. 

[0207] After the spatial fourth-order cumulant matrices (0, 0, 0) and (r, ,73,73) 
have been estimated, the generalized eigen analysis of the matrix-pencil is performed at 

step 62 to determine its finite spectra, X (cl (0, 0, 0) , (r, , , 73 )) . At step 64, the number, K, 

20 of distinct finite eigenvalues and multiplicity of each distinct eigenvalue are determined. The 

spectra will have M finite values, counting multiplicities, each corresponding to the normalized 

fourth-order auto-cumulant of a signal. Of the M eigenvalues there will be K distinct 
eigenvalues, //^ , A: g 1, 2, . . . , AT , each with a muhiplicity rj^^ . For each distinct eigenvalue % 

linearly independent eigenvectors are calculated. An index, k, is set to zero at step 66. The 
25 index, k, is used to ensure that each distinct eigenvalue is addressed. At step 68, the distinct 
eigenvalue index, k, is compared to the number of distinct finite eigenvalues, K. Given that at 
least one distinct eigenvalue exists, K will not be equal to zero. Thus, on the first iteration, k will 
be less than K, and the process will proceed to step 72, as indicated by the circled letter "A" in 
Figure 7 and Figure 8. At step 72, it is determined if the multiplicity, r|k, is greater than 1. If the 
30 multiplicity, rjk, is not greater than 1, the process proceeds to step 74. At step 74, an eigenvector 
Cj, is calculated for the eigenvalue for the distinct eigenvalue (kj = |ik). For each Aj = ju^^ with 

a multiplicity of one, a normalization factor /j is calculated at step 76. The separation vector is 
formed as yVj = /j^j at step 78. The separation vector, Wj, is utilized (appended) to form the 
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separation Matrix, W, at step 80, wherein the separation vectors are (by definition) the columns 
of the separation matrix, W. After the separation vector, Wj, is appended to the separation 
matrix, W, the index, k, is incremented at step 82. The process then proceeds to step 68, as 
indicated by the circled letter "B" in Figure 7 and Figure 8. At step 68, k is compared with K. If 
5 k is greater than K, then the separation matrix W is provided and available for subsequent 

processing at step 70. If k is not greater than K (step 68) then the process proceeds to step 72, as 
indicated by the circled letter "A" in Figure 7 and Figure 8. At step 72, it is determined if the 
multiplicity, r|k, is greater than 1. If the multiplicity, rjk, is greater than 1, the process proceeds to 

step 84. At step 84, iik linearly independent eigenvectors eigenvector ej, are calculated for the 
10 distinct eigenvalues (^ = ^k). For each repeated eigenvalue the rj^^ separation vectors are set 
equal to its associated eigenvectors as = kj , at step 86. The separation matrix, W, is formed 

at step 80 by appending the separation vectors W,. The index, k, is incremented again at step 82, 
and the process is repeated until all distinct eigenvalues are addressed (k is greater than K at step 
68). At step 68, if k is greater than K, the separation matrix, W, is provided and available for 
15 subsequent processing at step 70. At step 71, the separation matrix, W, is multipUed by the input 
signal x(t) to perform the separation. More specifically, a matrix representation of the input 
signal x(t) is multiplied by the Hermitian transpose of the separation matrix, W", in accordance 
with the following equation. 

y(^) = W"x(/) (251) 

20 [0208] Hvbrid Separation Matrix Weights 

[0209] The BSS system described above uses adaptive separation weights (adaptive 
weights). The method and system for performing BSS can also be implemented with hybrid 
adaptive separation weights (hybrid weights) the minimize the mean-squared error (MSE) due to 
interference-plus-noise. The minimum MSE (MMSE) hybrid weights are computed from the 
25 zero-lag spatial correlation matrix and from the generalized eigenvectors of the SFOCMP. Each 
eigenvector is used to estimate a corresponding source steering vector and source power. The 
zero-lag spatial correlation matrix, source steering vector, and source power estimates are used to 
form the estimated MMSE weight vector based on the interference-plus-noise spatial correlation 
matrix. 

30 [021 0] Figure 9 is a representative diagram of the BSS system described previously and 
is presented to illuminate the differences between adaptive weights and hybrid weights. In 
Figure 9, each source separation vector (i.e. adapted weight vector) corresponds to a normalized 
eigenvector of either the spatial fourth order cumulant matrix-pencil, or spatial correlation matrix 
pencil. Since each eigenvector is orthogonal to all the other source steering vectors, these 
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adaptive weights are designed to maximize the signal-to-interference ratio, or equivalently 
minimize the interference-to-signal ratio. 

[021 1] Block 901 outputs the array data x(t) an estimate of the spatial 4'^-order 
Cumulant or Correlation matrix pair is made in block 902 the result of which undergoes 
5 generalized eigenvalue decomposition in 903. The SFOCMP eigenvectors are normalized in 
block 904 forming the separation matrix which is applied to the array output data as shown in 
block 905. While the BSS embodiment described above and in Figure 9 estimates steering 
vectors as shown in block 906, the estimates are not used in the formation of the separation 
matrix W. 

1 0 [021 2] While normalized eigenvectors can be used effectively to suppress interferers, 
these adaptive weights are not constrained to limit errors in the output waveforms due to the 
additive Gaussian noise. A SFOCM based matrix-pencil approach with Hybrid adaptive weights 
uses both 2"^ order and 4* order statistic to form the adapted weights where the weight vectors 
are designed to minimized the mean-squared error due to both the interference and noise. This 

15 hybrid method uses the estimated zero-lag spatial correlation matrix, , the estimated steering 
vector of the y source, , and the estimated source power to form the interference-plus- 
noise correlation matrix Kj and thereby the y adapted weight vector w^^^^ . 

[0213] Since the j'^ eigenvector, ej satisfies equation (252) 
V'^ej = [o...O,f *,0...of where Sj = ejvj (252) 

20 , v^. is proportional to the product C^(0)ej = FC,(0) V'^ej = Vj{c^ j(0)ej) and the steering 
vector can be estimated by normalization. 

[0214] An estimate of the y '* source power can be derived from the unconstrained 
MMSE weight vector Wj = K:\j . In terms of , this can be rewritten as 
R^Wj - Vj = VjPjvfwj . Using the of estimates of Wj and Vj the source power estimate 
25 becomes: 



[021 5] With the steering vector estimate and source power estimate, the interference- 
plus-noise correlation matrix estimate for the y'* source is simply K. = R^-v P vf Thus 
the hybrid MMSE weight vector estimate for the j^^ source is given by; 



30 W;.*,, 



ir;v,. (253) 
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[021 6] This hybrid MMSE weight compared to the adaptive weight vector requires 
several additional steps including the inversion of the N interference-plus-noise correlation 
matrices. The hybrid MMSE weight vector trades off interference suppression for improved 
robustness to additive Gaussian noise, which become evermore important as signals' SNR 
5 become lower. In terms of adapted beam patterns, the normalized eigenvector weights place 
nulls in the different interference directions and maintains a unity gain in the desired source 
direction. The hybrid weights on the other hand, form lesser nulls in the interferes' directions 
and maintains a unity gain in the desired source direction, while additionally limiting the average 
side lobe levels in non-source directions. 

10 [021 7] Therefore, to optimize the signal-to-interference-plus-noise ratio, minimum mean- 
squared error adaptive separation weight vectors (hybrid weights) can be found from the matrix- 
pencil based steering vector estimates, spatial autocorrelation Matrix and estimated interference- 
plus-noise correlation matrices. Figure 10 shows an illustration of the system described above 
for generating hybrid separation weights. The differences from Figure 9 are shaded to highlight 

15 the differences. 

[021 8] An array output 1001 is used to estimate a spatial 4^^ order Cumulant 1002 on 
which GEVD is performed in block 1003. The output of 1003 is used as described above to 
estimate steering vectors in block and estimate the interference-plus-noise correlation Matrix, 
along with a estimate of the spatial correlation Matrix in block 1004. The spatial correlation 
20 Matrix also uses the Array Output for estimation. The hybrid separation weight vectors are 
generated in 0000 which forms the separation matrix W which is applied to the Array output to 
produce the signal y(t) in the same maimer as adaptive weights are used. 

[021 9] To illustrate the separation performance using the hybrid weights, average ISR 
and SINK perforaiance over 25 Monte Carlo trials versus SNR for two OMSK sources and a six 
25 sensor array (random mixing matrix and isotropic white noise) using adaptive weights (SFCM 
EigVEC and hybrid MMSE weights (SFCM Hybrid and R1,R2-MMSE) are shown as Figure 1 1 
a and 1 lb. 

[0220] As seen in Figure 1 la the normalized eigenvector weights provide marginally 
better suppression of the interference signals than do the Hybrid weights. However as shown in 
30 Figure 1 lb, the normalized eigenvector weighs provide no suppression of additive noise whereas 
the hybrid MMSE weights show significant suppression of both interference and noise. The 
hybrid MMSE weights also provide improved ISR at lower source input SNR. 

[0221 ] These results are repeated in Figures 12a and 12 b, where average ISR and SINR 
performance respectively over 25 Monte Carlo trials versus SNR for six GMSK sources and a 
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six sensor array (random mixing matrix and non-isotropic spatially and temporally correlated 
Gaussian noise) is shown for both the prior art weights and the hybrid MMSE weights. 

[0222] Therefore, Matrix-pencil based hybrid MMSE adaptive array weights are 
uniquely applicable to many scenarios where both co-channel interference and Gaussian noise 
5 must be suppressed such as SIGINT Mapping Processors, space-based radar adaptive 

suppression of clutter and one or more janmiers and suppression of direct-path source signals. 

[0223] A BSS technique as described herein may be embodied in the form of computer- 
implemented processes and system for practicing those processes. A BSS technique as described 
herein may also be embodied in the form of computer program code embodied in tangible media, 

10 such as floppy diskettes, read only memories (ROMs), CD-ROMs, hard drives, high density disk, 
or any other computer-readable storage medium, wherein, when the computer program code is 
loaded into and executed by a computer, the computer becomes a system for practicing the 
invention. The BSS technique as described herein may also be embodied in the form of 
computer program code, for example, whether stored in a storage medium, loaded into and/or 

1 5 executed by a computer, or transmitted over some transmission medium, such as over the 

electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein, when 
the computer program code is loaded into and executed by a computer, the computer becomes a 
system for practicing the invention. When implemented on a general-purpose processor, the 
computer program code segments configure the processor to create specific logic circuits. 

20 [0224] A blind source separation (BSS) technique in accordance with the present 
invention provides a robust higher-order cumulant based principle component blind source 
separation technique that performs well at low signal-to-noise ratios with the potential of 
performing well in the presence of temporally and spatially correlated noise. Furthermore, a new 
definition of a spatial fourth-order cumulant matrix suited to blind source separation with non- 
25 equal gain, directional sensors is provided, the definition of a spatial fourth-order cumulant 
matrix-pencil using temporal information is provided, the concept of the separation power 
efficiency as a measure of the algorithm's performance is provided, and the concept of wide 
sense equivalence between matrix-pencils are also provided. 

[0225] Applications of the BSS technique in accordance with the present invention 
30 include spectral monitoring, be it for signal intelligence or other applications such as radio 
astronomy, where Gaussian random noise processes dominate the received signals out of an 
array. This fourth-order array signal processing BSS technique in accordance with the present 
invention provides the ability to exploit spatial information to separate co-channel emitters for 
detection, classification, and identification. This is particularly appUcable to detecting signals 
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designed for a low probability of detection (LPD) or low probability of intercept (LPI) which 
may use ambient background electromagnetic radiation and known co-channel emitters as a 
means of concealment. The spatial fourth-order cumulant matrix-pencil based blind source 
separation technique in accordance with the present invention provides the capability to blindly 
5 separate unknown co-channel emitters that may be near or below the noise floor of the individual 
sensors. 

[0226] Although illustrated and described herein with reference to certain specific 
embodiments, the BSS technique as described herein is nevertheless not intended to be limited to 
the details shown. Rather, various modifications may be made in the details within the scope and 
1 0 range of equivalents of the claims and without departing from the spirit of the invention. 
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